Skip to content

Unify benchmark file download logic#7462

Merged
robert3005 merged 1 commit intodevelopfrom
rk/downloads
Apr 16, 2026
Merged

Unify benchmark file download logic#7462
robert3005 merged 1 commit intodevelopfrom
rk/downloads

Conversation

@robert3005
Copy link
Copy Markdown
Contributor

@robert3005 robert3005 commented Apr 16, 2026

Stop repeating same download logic all over codebase

There's still slight variation of this logic in statpopgen vcf download

Signed-off-by: Robert Kruszewski github@robertk.io

@robert3005
Unify benchmark file download logic
f4e605c 
Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005 robert3005 added changelog/chore A trivial change action/benchmark Trigger full benchmarks to run on this PR labels Apr 16, 2026
@0ax1 0ax1 self-requested a review April 16, 2026 10:37
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 16, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 16, 2026 •
edited
Loading

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done f4e605c 2 Explore Profiling Data
Previous Runs (1)
Status Commit Job Attempt Link
🟢 Done f4e605c 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 16, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.006x ➖

datafusion / vortex-file-compressed (1.006x ➖, 0↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 129626799 125709632 1.03
polarsignals_q01/datafusion:vortex-file-compressed 368873610 367637826 1.00
polarsignals_q02/datafusion:vortex-file-compressed 25511347 25920114 0.98
polarsignals_q03/datafusion:vortex-file-compressed 374910550 373005065 1.01
polarsignals_q04/datafusion:vortex-file-compressed 11538924 12201519 0.95
polarsignals_q05/datafusion:vortex-file-compressed 16947515 16344125 1.04
polarsignals_q06/datafusion:vortex-file-compressed 19322915 19335653 1.00
polarsignals_q07/datafusion:vortex-file-compressed 14550748 14782670 0.98
polarsignals_q08/datafusion:vortex-file-compressed 463259355 460896550 1.01
polarsignals_q09/datafusion:vortex-file-compressed 11559624 10808760 1.07

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 16, 2026

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 16, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.7%
Vortex (geomean): 0.948x ➖
Parquet (geomean): 0.955x ➖
Shifts: Parquet (control) -4.5% · Median polish -3.2%

datafusion / vortex-file-compressed (0.922x ➖, 3↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 5267160 7087506 0.74
fineweb_q01/datafusion:vortex-file-compressed 28989779 26677454 1.09
fineweb_q02/datafusion:vortex-file-compressed 31010286 31386265 0.99
fineweb_q03/datafusion:vortex-file-compressed 101353033 107312014 0.94
fineweb_q04/datafusion:vortex-file-compressed 252981324 253971189 1.00
fineweb_q05/datafusion:vortex-file-compressed 226566181 234862910 0.96
fineweb_q06/datafusion:vortex-file-compressed 🚀 64156999 73175148 0.88
fineweb_q07/datafusion:vortex-file-compressed 73167391 78097237 0.94
fineweb_q08/datafusion:vortex-file-compressed 🚀 25946799 32102212 0.81
datafusion / vortex-compact (0.934x ➖, 2↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5316473 5622918 0.95
fineweb_q01/datafusion:vortex-compact 162473656 172623283 0.94
fineweb_q02/datafusion:vortex-compact 163747308 168917210 0.97
fineweb_q03/datafusion:vortex-compact 1446798158 1606464836 0.90
fineweb_q04/datafusion:vortex-compact 🚀 1557765864 1778890207 0.88
fineweb_q05/datafusion:vortex-compact 🚀 1233064387 1399008194 0.88
fineweb_q06/datafusion:vortex-compact 700388471 700073498 1.00
fineweb_q07/datafusion:vortex-compact 733523044 736799117 1.00
fineweb_q08/datafusion:vortex-compact 22181223 24407579 0.91
datafusion / parquet (0.944x ➖, 0↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6398954 7060147 0.91
fineweb_q01/datafusion:parquet 279206772 309696925 0.90
fineweb_q02/datafusion:parquet 278003904 308852714 0.90
fineweb_q03/datafusion:parquet 292291204 294142346 0.99
fineweb_q04/datafusion:parquet 296242248 311230237 0.95
fineweb_q05/datafusion:parquet 292802156 303362819 0.97
fineweb_q06/datafusion:parquet 283098003 305800506 0.93
fineweb_q07/datafusion:parquet 282107574 286309963 0.99
fineweb_q08/datafusion:parquet 278069242 285119634 0.98
duckdb / vortex-file-compressed (1.001x ➖, 0↑ 1↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3226383 3496769 0.92
fineweb_q01/duckdb:vortex-file-compressed 28099917 27895507 1.01
fineweb_q02/duckdb:vortex-file-compressed 28500241 29084814 0.98
fineweb_q03/duckdb:vortex-file-compressed 🚨 166190126 135261275 1.23
fineweb_q04/duckdb:vortex-file-compressed 231096366 232075127 1.00
fineweb_q05/duckdb:vortex-file-compressed 222868301 217108528 1.03
fineweb_q06/duckdb:vortex-file-compressed 66843560 67067936 1.00
fineweb_q07/duckdb:vortex-file-compressed 68996424 71387983 0.97
fineweb_q08/duckdb:vortex-file-compressed 25314183 27704348 0.91
duckdb / vortex-compact (0.938x ➖, 1↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 3833921 4196864 0.91
fineweb_q01/duckdb:vortex-compact 107154322 106730619 1.00
fineweb_q02/duckdb:vortex-compact 113650769 126194910 0.90
fineweb_q03/duckdb:vortex-compact 850535795 898164150 0.95
fineweb_q04/duckdb:vortex-compact 902743932 963867372 0.94
fineweb_q05/duckdb:vortex-compact 813142909 847097697 0.96
fineweb_q06/duckdb:vortex-compact 466969660 489414594 0.95
fineweb_q07/duckdb:vortex-compact 472740470 499452867 0.95
fineweb_q08/duckdb:vortex-compact 🚀 20924554 23671828 0.88
duckdb / parquet (0.966x ➖, 1↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 28789420 30902245 0.93
fineweb_q01/duckdb:parquet 85543103 83459929 1.02
fineweb_q02/duckdb:parquet 82662092 84458627 0.98
fineweb_q03/duckdb:parquet 308139534 310600173 0.99
fineweb_q04/duckdb:parquet 439135751 439282473 1.00
fineweb_q05/duckdb:parquet 407095280 411513969 0.99
fineweb_q06/duckdb:parquet 197925211 198141678 1.00
fineweb_q07/duckdb:parquet 207253327 210011426 0.99
fineweb_q08/duckdb:parquet 🚀 27903974 34517242 0.81
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -5.4% -8.1% +2.9% +42.0% ➖ noise
0 datafusion:vortex-file-compressed -25.7% -8.1% -19.1% +51.1% ➖ noise
0 duckdb:vortex-compact -8.6% -8.1% -0.6% +35.3% ➖ noise
0 duckdb:vortex-file-compressed -7.7% -8.1% +0.4% +47.6% ➖ noise
1 datafusion:vortex-compact -5.9% -3.9% -2.1% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +8.7% -3.9% +13.0% +19.4% ➖ noise
1 duckdb:vortex-compact +0.4% -3.9% +4.4% +13.4% ➖ noise
1 duckdb:vortex-file-compressed +0.7% -3.9% +4.8% +36.0% ➖ noise
2 datafusion:vortex-compact -3.1% -6.1% +3.3% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -1.2% -6.1% +5.3% +14.6% ➖ noise
2 duckdb:vortex-compact -9.9% -6.1% -4.0% +15.6% ➖ noise
2 duckdb:vortex-file-compressed -2.0% -6.1% +4.4% +22.4% ➖ noise
3 datafusion:vortex-compact -9.9% -0.7% -9.3% +10.0% ✅ faster
3 datafusion:vortex-file-compressed -5.6% -0.7% -4.9% +19.2% ➖ noise
3 duckdb:vortex-compact -5.3% -0.7% -4.6% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +22.9% -0.7% +23.7% +20.7% 🚨 regression
4 datafusion:vortex-compact -12.4% -2.5% -10.2% +10.0% ✅ faster
4 datafusion:vortex-file-compressed -0.4% -2.5% +2.1% +10.0% ➖ noise
4 duckdb:vortex-compact -6.3% -2.5% -4.0% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.4% -2.5% +2.1% +10.0% ➖ noise
5 datafusion:vortex-compact -11.9% -2.3% -9.8% +10.0% ✅ faster
5 datafusion:vortex-file-compressed -3.5% -2.3% -1.3% +10.0% ➖ noise
5 duckdb:vortex-compact -4.0% -2.3% -1.8% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +2.7% -2.3% +5.1% +10.0% ➖ noise
6 datafusion:vortex-compact +0.0% -3.8% +4.0% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -12.3% -3.8% -8.8% +13.4% ➖ noise
6 duckdb:vortex-compact -4.6% -3.8% -0.8% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -0.3% -3.8% +3.6% +14.0% ➖ noise
7 datafusion:vortex-compact -0.4% -1.4% +1.0% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -6.3% -1.4% -5.0% +11.0% ➖ noise
7 duckdb:vortex-compact -5.3% -1.4% -4.0% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -3.4% -1.4% -2.0% +23.7% ➖ noise
8 datafusion:vortex-compact -9.1% -11.2% +2.3% +29.9% ➖ noise
8 datafusion:vortex-file-compressed -19.2% -11.2% -9.0% +24.6% ➖ noise
8 duckdb:vortex-compact -11.6% -11.2% -0.4% +20.6% ➖ noise
8 duckdb:vortex-file-compressed -8.6% -11.2% +2.9% +14.2% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 16, 2026

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 16, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.0%
Vortex (geomean): 0.883x ✅
Parquet (geomean): 0.902x ➖
Shifts: Parquet (control) -9.8% · Median polish -10.6%

datafusion / vortex-file-compressed (0.868x ✅, 17↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚀 49087052 56226627 0.87
tpch_q02/datafusion:vortex-file-compressed 33138656 36446048 0.91
tpch_q03/datafusion:vortex-file-compressed 🚀 26942590 32337602 0.83
tpch_q04/datafusion:vortex-file-compressed 🚀 18974277 22127013 0.86
tpch_q05/datafusion:vortex-file-compressed 🚀 52923252 63224974 0.84
tpch_q06/datafusion:vortex-file-compressed 🚀 10295944 11637847 0.88
tpch_q07/datafusion:vortex-file-compressed 🚀 63471934 74509936 0.85
tpch_q08/datafusion:vortex-file-compressed 🚀 46124368 52818348 0.87
tpch_q09/datafusion:vortex-file-compressed 🚀 55478330 63820272 0.87
tpch_q10/datafusion:vortex-file-compressed 🚀 44935857 51138776 0.88
tpch_q11/datafusion:vortex-file-compressed 17701625 19363066 0.91
tpch_q12/datafusion:vortex-file-compressed 🚀 24185133 28493600 0.85
tpch_q13/datafusion:vortex-file-compressed 🚀 27310804 31387931 0.87
tpch_q14/datafusion:vortex-file-compressed 🚀 15780187 18535610 0.85
tpch_q15/datafusion:vortex-file-compressed 🚀 24255335 28875302 0.84
tpch_q16/datafusion:vortex-file-compressed 24442428 26888639 0.91
tpch_q17/datafusion:vortex-file-compressed 🚀 62308714 78019881 0.80
tpch_q18/datafusion:vortex-file-compressed 🚀 78480919 94541303 0.83
tpch_q19/datafusion:vortex-file-compressed 24527616 26015156 0.94
tpch_q20/datafusion:vortex-file-compressed 33471326 37174535 0.90
tpch_q21/datafusion:vortex-file-compressed 🚀 75124040 88412327 0.85
tpch_q22/datafusion:vortex-file-compressed 🚀 16151946 18181421 0.89
datafusion / vortex-compact (0.874x ✅, 20↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚀 56357629 64482123 0.87
tpch_q02/datafusion:vortex-compact 36883689 40672151 0.91
tpch_q03/datafusion:vortex-compact 🚀 31006218 34704665 0.89
tpch_q04/datafusion:vortex-compact 🚀 23412946 26179972 0.89
tpch_q05/datafusion:vortex-compact 🚀 55951195 66503895 0.84
tpch_q06/datafusion:vortex-compact 🚀 13305876 15219093 0.87
tpch_q07/datafusion:vortex-compact 🚀 69489109 81121714 0.86
tpch_q08/datafusion:vortex-compact 🚀 50520167 57220813 0.88
tpch_q09/datafusion:vortex-compact 🚀 61055520 69590792 0.88
tpch_q10/datafusion:vortex-compact 🚀 53247801 60916199 0.87
tpch_q11/datafusion:vortex-compact 🚀 19196474 21721947 0.88
tpch_q12/datafusion:vortex-compact 🚀 32865962 37689117 0.87
tpch_q13/datafusion:vortex-compact 🚀 36141966 40698758 0.89
tpch_q14/datafusion:vortex-compact 🚀 20453798 22976609 0.89
tpch_q15/datafusion:vortex-compact 🚀 33655716 38513311 0.87
tpch_q16/datafusion:vortex-compact 🚀 29196295 33321412 0.88
tpch_q17/datafusion:vortex-compact 🚀 68141056 80469570 0.85
tpch_q18/datafusion:vortex-compact 🚀 83443774 100492288 0.83
tpch_q19/datafusion:vortex-compact 34368321 37721623 0.91
tpch_q20/datafusion:vortex-compact 🚀 37902305 43188295 0.88
tpch_q21/datafusion:vortex-compact 🚀 86954920 104574829 0.83
tpch_q22/datafusion:vortex-compact 🚀 16751965 19258485 0.87
datafusion / parquet (0.868x ✅, 13↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 92957665 118453338 0.78
tpch_q02/datafusion:parquet 69960463 72382183 0.97
tpch_q03/datafusion:parquet 80100469 80601052 0.99
tpch_q04/datafusion:parquet 47776682 49169037 0.97
tpch_q05/datafusion:parquet 103120211 106246482 0.97
tpch_q06/datafusion:parquet 🚀 40144258 46257945 0.87
tpch_q07/datafusion:parquet 🚀 109922273 155599130 0.71
tpch_q08/datafusion:parquet 🚀 103202766 129887716 0.79
tpch_q09/datafusion:parquet 🚀 134107535 174514001 0.77
tpch_q10/datafusion:parquet 🚀 122123195 163448562 0.75
tpch_q11/datafusion:parquet 🚀 46971924 63216744 0.74
tpch_q12/datafusion:parquet 🚀 96497924 111049544 0.87
tpch_q13/datafusion:parquet 🚀 204300360 278918598 0.73
tpch_q14/datafusion:parquet 50746298 54361870 0.93
tpch_q15/datafusion:parquet 68081593 73185660 0.93
tpch_q16/datafusion:parquet 🚀 50044317 56428047 0.89
tpch_q17/datafusion:parquet 🚀 132796967 151272835 0.88
tpch_q18/datafusion:parquet 🚀 165042284 185114944 0.89
tpch_q19/datafusion:parquet 90817254 92694542 0.98
tpch_q20/datafusion:parquet 77355883 83117491 0.93
tpch_q21/datafusion:parquet 🚀 143690037 159708076 0.90
tpch_q22/datafusion:parquet 34703408 36733094 0.94
datafusion / arrow (0.949x ➖, 2↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 55276174 59391548 0.93
tpch_q02/datafusion:arrow 21352521 22601866 0.94
tpch_q03/datafusion:arrow 32286808 35275959 0.92
tpch_q04/datafusion:arrow 26835118 29397286 0.91
tpch_q05/datafusion:arrow 74988204 78856557 0.95
tpch_q06/datafusion:arrow 20604598 20493232 1.01
tpch_q07/datafusion:arrow 111529034 112474253 0.99
tpch_q08/datafusion:arrow 43443235 46343339 0.94
tpch_q09/datafusion:arrow 69521183 73928761 0.94
tpch_q10/datafusion:arrow 🚀 50329372 57289785 0.88
tpch_q11/datafusion:arrow 11483881 11775640 0.98
tpch_q12/datafusion:arrow 54076371 56797109 0.95
tpch_q13/datafusion:arrow 48874819 49488598 0.99
tpch_q14/datafusion:arrow 🚀 22281204 24763464 0.90
tpch_q15/datafusion:arrow 45974918 48230463 0.95
tpch_q16/datafusion:arrow 21031247 21484777 0.98
tpch_q17/datafusion:arrow 69244647 73214221 0.95
tpch_q18/datafusion:arrow 141814299 148573076 0.95
tpch_q19/datafusion:arrow 38801560 39051049 0.99
tpch_q20/datafusion:arrow 38230724 39771620 0.96
tpch_q21/datafusion:arrow 147405119 159944834 0.92
tpch_q22/datafusion:arrow 19762804 20512296 0.96
duckdb / vortex-file-compressed (0.869x ✅, 20↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚀 33183473 39954094 0.83
tpch_q02/duckdb:vortex-file-compressed 🚀 27326977 30429317 0.90
tpch_q03/duckdb:vortex-file-compressed 🚀 28860042 32672982 0.88
tpch_q04/duckdb:vortex-file-compressed 30743997 33985807 0.90
tpch_q05/duckdb:vortex-file-compressed 🚀 33023915 39512703 0.84
tpch_q06/duckdb:vortex-file-compressed 🚀 10845117 12196339 0.89
tpch_q07/duckdb:vortex-file-compressed 🚀 37398292 43901713 0.85
tpch_q08/duckdb:vortex-file-compressed 🚀 40646996 46486025 0.87
tpch_q09/duckdb:vortex-file-compressed 🚀 82289944 93952905 0.88
tpch_q10/duckdb:vortex-file-compressed 🚀 37051454 41533386 0.89
tpch_q11/duckdb:vortex-file-compressed 🚀 16294914 18468900 0.88
tpch_q12/duckdb:vortex-file-compressed 🚀 23444644 26206318 0.89
tpch_q13/duckdb:vortex-file-compressed 🚀 37624700 42350537 0.89
tpch_q14/duckdb:vortex-file-compressed 🚀 22373479 25999943 0.86
tpch_q15/duckdb:vortex-file-compressed 🚀 15926978 17825484 0.89
tpch_q16/duckdb:vortex-file-compressed 🚀 29309606 35660004 0.82
tpch_q17/duckdb:vortex-file-compressed 25294958 27775971 0.91
tpch_q18/duckdb:vortex-file-compressed 🚀 51444313 59308203 0.87
tpch_q19/duckdb:vortex-file-compressed 🚀 31392282 38512065 0.82
tpch_q20/duckdb:vortex-file-compressed 🚀 34389636 38799547 0.89
tpch_q21/duckdb:vortex-file-compressed 🚀 109124978 133345837 0.82
tpch_q22/duckdb:vortex-file-compressed 🚀 18392042 21549965 0.85
duckdb / vortex-compact (0.923x ➖, 11↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 39687119 42243004 0.94
tpch_q02/duckdb:vortex-compact 37933604 41020095 0.92
tpch_q03/duckdb:vortex-compact 🚀 32205632 36719366 0.88
tpch_q04/duckdb:vortex-compact 🚀 34137343 39348574 0.87
tpch_q05/duckdb:vortex-compact 🚀 37410475 41611781 0.90
tpch_q06/duckdb:vortex-compact 🚀 14630320 16260499 0.90
tpch_q07/duckdb:vortex-compact 🚀 42671810 47725004 0.89
tpch_q08/duckdb:vortex-compact 45568924 50148750 0.91
tpch_q09/duckdb:vortex-compact 🚀 88729323 104057989 0.85
tpch_q10/duckdb:vortex-compact 🚀 40694438 45643112 0.89
tpch_q11/duckdb:vortex-compact 🚀 19888674 22586353 0.88
tpch_q12/duckdb:vortex-compact 🚀 35614531 39828985 0.89
tpch_q13/duckdb:vortex-compact 🚀 46940102 52486977 0.89
tpch_q14/duckdb:vortex-compact 29465305 32711696 0.90
tpch_q15/duckdb:vortex-compact 🚀 19027969 22224962 0.86
tpch_q16/duckdb:vortex-compact 36494327 37332520 0.98
tpch_q17/duckdb:vortex-compact 31638052 30845051 1.03
tpch_q18/duckdb:vortex-compact 50943058 51640602 0.99
tpch_q19/duckdb:vortex-compact 36968282 37879479 0.98
tpch_q20/duckdb:vortex-compact 43252604 43626345 0.99
tpch_q21/duckdb:vortex-compact 111825135 111161084 1.01
tpch_q22/duckdb:vortex-compact 20909294 20845427 1.00
duckdb / parquet (0.939x ➖, 6↑ 2↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 75470961 77549064 0.97
tpch_q02/duckdb:parquet 39055382 42146698 0.93
tpch_q03/duckdb:parquet 🚨 81527738 73857508 1.10
tpch_q04/duckdb:parquet 46688780 50291271 0.93
tpch_q05/duckdb:parquet 66159929 73399969 0.90
tpch_q06/duckdb:parquet 19764556 21820513 0.91
tpch_q07/duckdb:parquet 67917749 72624288 0.94
tpch_q08/duckdb:parquet 95884460 87667292 1.09
tpch_q09/duckdb:parquet 140841773 146217439 0.96
tpch_q10/duckdb:parquet 115266973 125405460 0.92
tpch_q11/duckdb:parquet 🚀 21998081 25911163 0.85
tpch_q12/duckdb:parquet 🚀 45305125 51006513 0.89
tpch_q13/duckdb:parquet 🚀 248722048 285527809 0.87
tpch_q14/duckdb:parquet 48641585 52432268 0.93
tpch_q15/duckdb:parquet 🚨 29434056 25819302 1.14
tpch_q16/duckdb:parquet 56426697 62149616 0.91
tpch_q17/duckdb:parquet 54627135 55954255 0.98
tpch_q18/duckdb:parquet 110265919 118717779 0.93
tpch_q19/duckdb:parquet 🚀 64664197 72727405 0.89
tpch_q20/duckdb:parquet 🚀 64084117 73875368 0.87
tpch_q21/duckdb:parquet 165019707 179373214 0.92
tpch_q22/duckdb:parquet 🚀 51554993 57694747 0.89
duckdb / duckdb (0.990x ➖, 1↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 15738476 16076330 0.98
tpch_q02/duckdb:duckdb 13371035 12871474 1.04
tpch_q03/duckdb:duckdb 18765759 19770926 0.95
tpch_q04/duckdb:duckdb 18930945 19233472 0.98
tpch_q05/duckdb:duckdb 19615664 19833310 0.99
tpch_q06/duckdb:duckdb 5148050 5354805 0.96
tpch_q07/duckdb:duckdb 22052908 22352217 0.99
tpch_q08/duckdb:duckdb 20688662 20875190 0.99
tpch_q09/duckdb:duckdb 53738859 54200518 0.99
tpch_q10/duckdb:duckdb 44693599 42650037 1.05
tpch_q11/duckdb:duckdb 5765051 5765779 1.00
tpch_q12/duckdb:duckdb 13612476 13569453 1.00
tpch_q13/duckdb:duckdb 37624538 38751614 0.97
tpch_q14/duckdb:duckdb 🚀 16123633 17942257 0.90
tpch_q15/duckdb:duckdb 12015460 11665177 1.03
tpch_q16/duckdb:duckdb 24103667 23727991 1.02
tpch_q17/duckdb:duckdb 13684779 13752642 1.00
tpch_q18/duckdb:duckdb 38876830 37910927 1.03
tpch_q19/duckdb:duckdb 25967910 28116340 0.92
tpch_q20/duckdb:duckdb 23456503 22480385 1.04
tpch_q21/duckdb:duckdb 56282390 56832036 0.99
tpch_q22/duckdb:duckdb 23901535 24205814 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -6.9% -12.6% +6.5% +19.9% ➖ noise
1 datafusion:vortex-compact -12.6% -12.6% +0.0% +19.9% ➖ noise
1 datafusion:vortex-file-compressed -12.7% -12.6% -0.1% +19.9% ➖ noise
1 duckdb:duckdb -2.1% -12.6% +12.0% +19.9% ➖ noise
1 duckdb:vortex-compact -6.1% -12.6% +7.5% +19.9% ➖ noise
1 duckdb:vortex-file-compressed -16.9% -12.6% -5.0% +19.9% ➖ noise
2 datafusion:arrow -5.5% -5.4% -0.2% +19.9% ➖ noise
2 datafusion:vortex-compact -9.3% -5.4% -4.2% +19.9% ➖ noise
2 datafusion:vortex-file-compressed -9.1% -5.4% -3.9% +19.9% ➖ noise
2 duckdb:duckdb +3.9% -5.4% +9.8% +19.9% ➖ noise
2 duckdb:vortex-compact -7.5% -5.4% -2.3% +19.9% ➖ noise
2 duckdb:vortex-file-compressed -10.2% -5.4% -5.1% +19.9% ➖ noise
3 datafusion:arrow -8.5% +4.7% -12.6% +19.9% ➖ noise
3 datafusion:vortex-compact -10.7% +4.7% -14.7% +19.9% ➖ noise
3 datafusion:vortex-file-compressed -16.7% +4.7% -20.5% +19.9% ✅ faster
3 duckdb:duckdb -5.1% +4.7% -9.4% +19.9% ➖ noise
3 duckdb:vortex-compact -12.3% +4.7% -16.3% +19.9% ➖ noise
3 duckdb:vortex-file-compressed -11.7% +4.7% -15.7% +19.9% ➖ noise
4 datafusion:arrow -8.7% -5.0% -3.9% +19.9% ➖ noise
4 datafusion:vortex-compact -10.6% -5.0% -5.8% +19.9% ➖ noise
4 datafusion:vortex-file-compressed -14.2% -5.0% -9.7% +19.9% ➖ noise
4 duckdb:duckdb -1.6% -5.0% +3.6% +19.9% ➖ noise
4 duckdb:vortex-compact -13.2% -5.0% -8.7% +19.9% ➖ noise
4 duckdb:vortex-file-compressed -9.5% -5.0% -4.8% +19.9% ➖ noise
5 datafusion:arrow -4.9% -6.5% +1.7% +19.9% ➖ noise
5 datafusion:vortex-compact -15.9% -6.5% -10.1% +19.9% ➖ noise
5 datafusion:vortex-file-compressed -16.3% -6.5% -10.5% +19.9% ➖ noise
5 duckdb:duckdb -1.1% -6.5% +5.7% +19.9% ➖ noise
5 duckdb:vortex-compact -10.1% -6.5% -3.9% +19.9% ➖ noise
5 duckdb:vortex-file-compressed -16.4% -6.5% -10.6% +19.9% ➖ noise
6 datafusion:arrow +0.5% -11.3% +13.4% +19.9% ➖ noise
6 datafusion:vortex-compact -12.6% -11.3% -1.4% +19.9% ➖ noise
6 datafusion:vortex-file-compressed -11.5% -11.3% -0.2% +19.9% ➖ noise
6 duckdb:duckdb -3.9% -11.3% +8.4% +19.9% ➖ noise
6 duckdb:vortex-compact -10.0% -11.3% +1.5% +19.9% ➖ noise
6 duckdb:vortex-file-compressed -11.1% -11.3% +0.3% +19.9% ➖ noise
7 datafusion:arrow -0.8% -18.7% +22.0% +19.9% 🚨 regression
7 datafusion:vortex-compact -14.3% -18.7% +5.4% +19.9% ➖ noise
7 datafusion:vortex-file-compressed -14.8% -18.7% +4.8% +19.9% ➖ noise
7 duckdb:duckdb -1.3% -18.7% +21.4% +19.9% 🚨 regression
7 duckdb:vortex-compact -10.6% -18.7% +10.0% +19.9% ➖ noise
7 duckdb:vortex-file-compressed -14.8% -18.7% +4.8% +19.9% ➖ noise
8 datafusion:arrow -6.3% -6.8% +0.6% +19.9% ➖ noise
8 datafusion:vortex-compact -11.7% -6.8% -5.3% +19.9% ➖ noise
8 datafusion:vortex-file-compressed -12.7% -6.8% -6.3% +19.9% ➖ noise
8 duckdb:duckdb -0.9% -6.8% +6.3% +19.9% ➖ noise
8 duckdb:vortex-compact -9.1% -6.8% -2.5% +19.9% ➖ noise
8 duckdb:vortex-file-compressed -12.6% -6.8% -6.2% +19.9% ➖ noise
9 datafusion:arrow -6.0% -14.0% +9.3% +19.9% ➖ noise
9 datafusion:vortex-compact -12.3% -14.0% +2.0% +19.9% ➖ noise
9 datafusion:vortex-file-compressed -13.1% -14.0% +1.0% +19.9% ➖ noise
9 duckdb:duckdb -0.9% -14.0% +15.2% +19.9% ➖ noise
9 duckdb:vortex-compact -14.7% -14.0% -0.9% +19.9% ➖ noise
9 duckdb:vortex-file-compressed -12.4% -14.0% +1.8% +19.9% ➖ noise
10 datafusion:arrow -12.1% -17.1% +6.0% +19.9% ➖ noise
10 datafusion:vortex-compact -12.6% -17.1% +5.5% +19.9% ➖ noise
10 datafusion:vortex-file-compressed -12.1% -17.1% +6.0% +19.9% ➖ noise
10 duckdb:duckdb +4.8% -17.1% +26.5% +19.9% 🚨 regression
10 duckdb:vortex-compact -10.8% -17.1% +7.6% +19.9% ➖ noise
10 duckdb:vortex-file-compressed -10.8% -17.1% +7.6% +19.9% ➖ noise
11 datafusion:arrow -2.5% -20.6% +22.8% +19.9% 🚨 regression
11 datafusion:vortex-compact -11.6% -20.6% +11.3% +19.9% ➖ noise
11 datafusion:vortex-file-compressed -8.6% -20.6% +15.1% +19.9% ➖ noise
11 duckdb:duckdb -0.0% -20.6% +25.9% +19.9% 🚨 regression
11 duckdb:vortex-compact -11.9% -20.6% +10.9% +19.9% ➖ noise
11 duckdb:vortex-file-compressed -11.8% -20.6% +11.1% +19.9% ➖ noise
12 datafusion:arrow -4.8% -12.1% +8.4% +19.9% ➖ noise
12 datafusion:vortex-compact -12.8% -12.1% -0.7% +19.9% ➖ noise
12 datafusion:vortex-file-compressed -15.1% -12.1% -3.4% +19.9% ➖ noise
12 duckdb:duckdb +0.3% -12.1% +14.2% +19.9% ➖ noise
12 duckdb:vortex-compact -10.6% -12.1% +1.8% +19.9% ➖ noise
12 duckdb:vortex-file-compressed -10.5% -12.1% +1.8% +19.9% ➖ noise
13 datafusion:arrow -1.2% -20.1% +23.6% +19.9% 🚨 regression
13 datafusion:vortex-compact -11.2% -20.1% +11.2% +19.9% ➖ noise
13 datafusion:vortex-file-compressed -13.0% -20.1% +8.9% +19.9% ➖ noise
13 duckdb:duckdb -2.9% -20.1% +21.5% +19.9% 🚨 regression
13 duckdb:vortex-compact -10.6% -20.1% +12.0% +19.9% ➖ noise
13 duckdb:vortex-file-compressed -11.2% -20.1% +11.2% +19.9% ➖ noise
14 datafusion:arrow -10.0% -6.9% -3.3% +19.9% ➖ noise
14 datafusion:vortex-compact -11.0% -6.9% -4.3% +19.9% ➖ noise
14 datafusion:vortex-file-compressed -14.9% -6.9% -8.5% +19.9% ➖ noise
14 duckdb:duckdb -10.1% -6.9% -3.4% +19.9% ➖ noise
14 duckdb:vortex-compact -9.9% -6.9% -3.2% +19.9% ➖ noise
14 duckdb:vortex-file-compressed -13.9% -6.9% -7.5% +19.9% ➖ noise
15 datafusion:arrow -4.7% +3.0% -7.4% +19.9% ➖ noise
15 datafusion:vortex-compact -12.6% +3.0% -15.1% +19.9% ➖ noise
15 datafusion:vortex-file-compressed -16.0% +3.0% -18.4% +19.9% ✅ faster
15 duckdb:duckdb +3.0% +3.0% +0.0% +19.9% ➖ noise
15 duckdb:vortex-compact -14.4% +3.0% -16.9% +19.9% ✅ faster
15 duckdb:vortex-file-compressed -10.7% +3.0% -13.2% +19.9% ➖ noise
16 datafusion:arrow -2.1% -10.3% +9.1% +19.9% ➖ noise
16 datafusion:vortex-compact -12.4% -10.3% -2.4% +19.9% ➖ noise
16 datafusion:vortex-file-compressed -9.1% -10.3% +1.3% +19.9% ➖ noise
16 duckdb:duckdb +1.6% -10.3% +13.2% +19.9% ➖ noise
16 duckdb:vortex-compact -2.2% -10.3% +8.9% +19.9% ➖ noise
16 duckdb:vortex-file-compressed -17.8% -10.3% -8.4% +19.9% ➖ noise
17 datafusion:arrow -5.4% -7.4% +2.2% +19.9% ➖ noise
17 datafusion:vortex-compact -15.3% -7.4% -8.5% +19.9% ➖ noise
17 datafusion:vortex-file-compressed -20.1% -7.4% -13.7% +19.9% ➖ noise
17 duckdb:duckdb -0.5% -7.4% +7.5% +19.9% ➖ noise
17 duckdb:vortex-compact +2.6% -7.4% +10.8% +19.9% ➖ noise
17 duckdb:vortex-file-compressed -8.9% -7.4% -1.6% +19.9% ➖ noise
18 datafusion:arrow -4.5% -9.0% +4.9% +19.9% ➖ noise
18 datafusion:vortex-compact -17.0% -9.0% -8.8% +19.9% ➖ noise
18 datafusion:vortex-file-compressed -17.0% -9.0% -8.8% +19.9% ➖ noise
18 duckdb:duckdb +2.5% -9.0% +12.7% +19.9% ➖ noise
18 duckdb:vortex-compact -1.4% -9.0% +8.4% +19.9% ➖ noise
18 duckdb:vortex-file-compressed -13.3% -9.0% -4.7% +19.9% ➖ noise
19 datafusion:arrow -0.6% -6.7% +6.5% +19.9% ➖ noise
19 datafusion:vortex-compact -8.9% -6.7% -2.4% +19.9% ➖ noise
19 datafusion:vortex-file-compressed -5.7% -6.7% +1.0% +19.9% ➖ noise
19 duckdb:duckdb -7.6% -6.7% -1.0% +19.9% ➖ noise
19 duckdb:vortex-compact -2.4% -6.7% +4.6% +19.9% ➖ noise
19 duckdb:vortex-file-compressed -18.5% -6.7% -12.7% +19.9% ➖ noise
20 datafusion:arrow -3.9% -10.1% +7.0% +19.9% ➖ noise
20 datafusion:vortex-compact -12.2% -10.1% -2.3% +19.9% ➖ noise
20 datafusion:vortex-file-compressed -10.0% -10.1% +0.2% +19.9% ➖ noise
20 duckdb:duckdb +4.3% -10.1% +16.1% +19.9% ➖ noise
20 duckdb:vortex-compact -0.9% -10.1% +10.3% +19.9% ➖ noise
20 duckdb:vortex-file-compressed -11.4% -10.1% -1.4% +19.9% ➖ noise
21 datafusion:arrow -7.8% -9.0% +1.3% +19.9% ➖ noise
21 datafusion:vortex-compact -16.8% -9.0% -8.6% +19.9% ➖ noise
21 datafusion:vortex-file-compressed -15.0% -9.0% -6.6% +19.9% ➖ noise
21 duckdb:duckdb -1.0% -9.0% +8.9% +19.9% ➖ noise
21 duckdb:vortex-compact +0.6% -9.0% +10.6% +19.9% ➖ noise
21 duckdb:vortex-file-compressed -18.2% -9.0% -10.0% +19.9% ➖ noise
22 datafusion:arrow -3.7% -8.1% +4.9% +19.9% ➖ noise
22 datafusion:vortex-compact -13.0% -8.1% -5.3% +19.9% ➖ noise
22 datafusion:vortex-file-compressed -11.2% -8.1% -3.3% +19.9% ➖ noise
22 duckdb:duckdb -1.3% -8.1% +7.5% +19.9% ➖ noise
22 duckdb:vortex-compact +0.3% -8.1% +9.2% +19.9% ➖ noise
22 duckdb:vortex-file-compressed -14.7% -8.1% -7.1% +19.9% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 16, 2026

File Sizes: TPC-H SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 16, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Vortex (geomean): 1.014x ➖
Parquet (geomean): 1.010x ➖
Shifts: Parquet (control) +1.0% · Median polish +1.2%

datafusion / vortex-file-compressed (1.013x ➖, 0↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 28773396 28411246 1.01
tpcds_q02/datafusion:vortex-file-compressed 53942861 53061875 1.02
tpcds_q03/datafusion:vortex-file-compressed 20314033 19804404 1.03
tpcds_q04/datafusion:vortex-file-compressed 294979216 287773456 1.03
tpcds_q05/datafusion:vortex-file-compressed 53554885 55463688 0.97
tpcds_q06/datafusion:vortex-file-compressed 51412925 50015726 1.03
tpcds_q07/datafusion:vortex-file-compressed 52538167 49774549 1.06
tpcds_q08/datafusion:vortex-file-compressed 35879735 35648234 1.01
tpcds_q09/datafusion:vortex-file-compressed 60032772 60040084 1.00
tpcds_q10/datafusion:vortex-file-compressed 44141082 44355279 1.00
tpcds_q11/datafusion:vortex-file-compressed 164980928 168583618 0.98
tpcds_q12/datafusion:vortex-file-compressed 22914659 22583715 1.01
tpcds_q13/datafusion:vortex-file-compressed 54999038 55607846 0.99
tpcds_q14/datafusion:vortex-file-compressed 198753124 194301236 1.02
tpcds_q15/datafusion:vortex-file-compressed 38155900 35201800 1.08
tpcds_q16/datafusion:vortex-file-compressed 29389143 29755771 0.99
tpcds_q17/datafusion:vortex-file-compressed 67072832 66941789 1.00
tpcds_q18/datafusion:vortex-file-compressed 80680874 77815691 1.04
tpcds_q19/datafusion:vortex-file-compressed 29025325 28986249 1.00
tpcds_q20/datafusion:vortex-file-compressed 26304015 26653810 0.99
tpcds_q21/datafusion:vortex-file-compressed 136228460 135607796 1.00
tpcds_q22/datafusion:vortex-file-compressed 57584725 56937645 1.01
tpcds_q23/datafusion:vortex-file-compressed 146382772 145088628 1.01
tpcds_q24/datafusion:vortex-file-compressed 113223484 110540548 1.02
tpcds_q25/datafusion:vortex-file-compressed 66869810 65961845 1.01
tpcds_q26/datafusion:vortex-file-compressed 36415302 37266655 0.98
tpcds_q27/datafusion:vortex-file-compressed 120091504 120515687 1.00
tpcds_q28/datafusion:vortex-file-compressed 52773213 52209248 1.01
tpcds_q29/datafusion:vortex-file-compressed 66385146 64960909 1.02
tpcds_q30/datafusion:vortex-file-compressed 31679944 32172500 0.98
tpcds_q31/datafusion:vortex-file-compressed 95728485 94216760 1.02
tpcds_q32/datafusion:vortex-file-compressed 21888777 20716127 1.06
tpcds_q33/datafusion:vortex-file-compressed 38930987 37868288 1.03
tpcds_q34/datafusion:vortex-file-compressed 30615770 30498118 1.00
tpcds_q35/datafusion:vortex-file-compressed 54557653 54878132 0.99
tpcds_q36/datafusion:vortex-file-compressed 75931876 75273281 1.01
tpcds_q37/datafusion:vortex-file-compressed 36052372 34261565 1.05
tpcds_q38/datafusion:vortex-file-compressed 52854590 53267816 0.99
tpcds_q39/datafusion:vortex-file-compressed 151739056 143894976 1.05
tpcds_q40/datafusion:vortex-file-compressed 53025456 53426323 0.99
tpcds_q41/datafusion:vortex-file-compressed 18724352 17470219 1.07
tpcds_q42/datafusion:vortex-file-compressed 18181046 18419775 0.99
tpcds_q43/datafusion:vortex-file-compressed 32470556 31055368 1.05
tpcds_q44/datafusion:vortex-file-compressed 40675194 40909245 0.99
tpcds_q45/datafusion:vortex-file-compressed 35366912 34142028 1.04
tpcds_q46/datafusion:vortex-file-compressed 47304208 46990589 1.01
tpcds_q47/datafusion:vortex-file-compressed 202292215 200113510 1.01
tpcds_q48/datafusion:vortex-file-compressed 43437318 42947859 1.01
tpcds_q49/datafusion:vortex-file-compressed 70028935 69440331 1.01
tpcds_q50/datafusion:vortex-file-compressed 45016680 44325455 1.02
tpcds_q51/datafusion:vortex-file-compressed 90609674 89115245 1.02
tpcds_q52/datafusion:vortex-file-compressed 17945035 19171343 0.94
tpcds_q53/datafusion:vortex-file-compressed 24573185 24849405 0.99
tpcds_q54/datafusion:vortex-file-compressed 44608147 43384252 1.03
tpcds_q55/datafusion:vortex-file-compressed 18727584 17530126 1.07
tpcds_q56/datafusion:vortex-file-compressed 39784434 38786283 1.03
tpcds_q57/datafusion:vortex-file-compressed 132465372 129075871 1.03
tpcds_q58/datafusion:vortex-file-compressed 70354464 68822326 1.02
tpcds_q59/datafusion:vortex-file-compressed 72631481 74445150 0.98
tpcds_q60/datafusion:vortex-file-compressed 40323394 40250720 1.00
tpcds_q61/datafusion:vortex-file-compressed 49541024 49001656 1.01
tpcds_q62/datafusion:vortex-file-compressed 31865282 32154887 0.99
tpcds_q63/datafusion:vortex-file-compressed 25202987 25380436 0.99
tpcds_q64/datafusion:vortex-file-compressed 467118689 465367244 1.00
tpcds_q65/datafusion:vortex-file-compressed 48580079 48228691 1.01
tpcds_q66/datafusion:vortex-file-compressed 91061867 93075340 0.98
tpcds_q67/datafusion:vortex-file-compressed 115300884 117740033 0.98
tpcds_q68/datafusion:vortex-file-compressed 44791793 45346048 0.99
tpcds_q69/datafusion:vortex-file-compressed 41747954 40901266 1.02
tpcds_q70/datafusion:vortex-file-compressed 114361488 111807451 1.02
tpcds_q71/datafusion:vortex-file-compressed 30295809 29566808 1.02
tpcds_q72/datafusion:vortex-file-compressed 2616607201 2571722747 1.02
tpcds_q73/datafusion:vortex-file-compressed 33087394 32608720 1.01
tpcds_q74/datafusion:vortex-file-compressed 116945568 114573030 1.02
tpcds_q75/datafusion:vortex-file-compressed 121709597 117485772 1.04
tpcds_q76/datafusion:vortex-file-compressed 33370016 32753660 1.02
tpcds_q77/datafusion:vortex-file-compressed 52478690 50802473 1.03
tpcds_q78/datafusion:vortex-file-compressed 124521696 123759558 1.01
tpcds_q79/datafusion:vortex-file-compressed 38203636 37438568 1.02
tpcds_q80/datafusion:vortex-file-compressed 114245842 112562412 1.01
tpcds_q81/datafusion:vortex-file-compressed 35683191 36319683 0.98
tpcds_q82/datafusion:vortex-file-compressed 36633394 35872084 1.02
tpcds_q83/datafusion:vortex-file-compressed 51652011 51289611 1.01
tpcds_q84/datafusion:vortex-file-compressed 16123849 15515418 1.04
tpcds_q85/datafusion:vortex-file-compressed 101864916 101200931 1.01
tpcds_q86/datafusion:vortex-file-compressed 19443233 18224891 1.07
tpcds_q87/datafusion:vortex-file-compressed 52509770 50113243 1.05
tpcds_q88/datafusion:vortex-file-compressed 69473523 68711466 1.01
tpcds_q89/datafusion:vortex-file-compressed 36255874 35807693 1.01
tpcds_q90/datafusion:vortex-file-compressed 18186317 18159509 1.00
tpcds_q91/datafusion:vortex-file-compressed 25813429 26213564 0.98
tpcds_q92/datafusion:vortex-file-compressed 19548318 18472067 1.06
tpcds_q93/datafusion:vortex-file-compressed 33388983 33293995 1.00
tpcds_q94/datafusion:vortex-file-compressed 24381799 24893881 0.98
tpcds_q95/datafusion:vortex-file-compressed 61794017 60746287 1.02
tpcds_q96/datafusion:vortex-file-compressed 15319766 15506636 0.99
tpcds_q97/datafusion:vortex-file-compressed 30280506 29506245 1.03
tpcds_q98/datafusion:vortex-file-compressed 33680474 32693920 1.03
tpcds_q99/datafusion:vortex-file-compressed 47139283 45461334 1.04
datafusion / vortex-compact (1.007x ➖, 0↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 35230360 34247669 1.03
tpcds_q02/datafusion:vortex-compact 60900750 59873472 1.02
tpcds_q03/datafusion:vortex-compact 26733204 25829360 1.03
tpcds_q04/datafusion:vortex-compact 333010987 326703305 1.02
tpcds_q05/datafusion:vortex-compact 65038118 66629709 0.98
tpcds_q06/datafusion:vortex-compact 56992975 57549626 0.99
tpcds_q07/datafusion:vortex-compact 64886281 65839831 0.99
tpcds_q08/datafusion:vortex-compact 44653770 44207839 1.01
tpcds_q09/datafusion:vortex-compact 72140876 72883172 0.99
tpcds_q10/datafusion:vortex-compact 65859819 65985260 1.00
tpcds_q11/datafusion:vortex-compact 191458873 191882642 1.00
tpcds_q12/datafusion:vortex-compact 27303505 28374417 0.96
tpcds_q13/datafusion:vortex-compact 131157804 126042459 1.04
tpcds_q14/datafusion:vortex-compact 256415012 258646546 0.99
tpcds_q15/datafusion:vortex-compact 39381645 38913950 1.01
tpcds_q16/datafusion:vortex-compact 39084479 38251494 1.02
tpcds_q17/datafusion:vortex-compact 92218420 91488823 1.01
tpcds_q18/datafusion:vortex-compact 90460500 90025992 1.00
tpcds_q19/datafusion:vortex-compact 44719322 43900203 1.02
tpcds_q20/datafusion:vortex-compact 30520885 31117320 0.98
tpcds_q21/datafusion:vortex-compact 143600454 139858290 1.03
tpcds_q22/datafusion:vortex-compact 64744393 65477361 0.99
tpcds_q23/datafusion:vortex-compact 188078632 182763723 1.03
tpcds_q24/datafusion:vortex-compact 144130971 141507245 1.02
tpcds_q25/datafusion:vortex-compact 95212022 95202494 1.00
tpcds_q26/datafusion:vortex-compact 46070537 46418641 0.99
tpcds_q27/datafusion:vortex-compact 156335052 155156013 1.01
tpcds_q28/datafusion:vortex-compact 88135490 86960166 1.01
tpcds_q29/datafusion:vortex-compact 93455861 93404075 1.00
tpcds_q30/datafusion:vortex-compact 35394505 34576947 1.02
tpcds_q31/datafusion:vortex-compact 135820960 132504718 1.03
tpcds_q32/datafusion:vortex-compact 28579471 26542126 1.08
tpcds_q33/datafusion:vortex-compact 54615879 54276976 1.01
tpcds_q34/datafusion:vortex-compact 50625069 50840359 1.00
tpcds_q35/datafusion:vortex-compact 70966281 70528666 1.01
tpcds_q36/datafusion:vortex-compact 102633647 99752128 1.03
tpcds_q37/datafusion:vortex-compact 47969689 47340829 1.01
tpcds_q38/datafusion:vortex-compact 71031457 69554018 1.02
tpcds_q39/datafusion:vortex-compact 149988097 145329508 1.03
tpcds_q40/datafusion:vortex-compact 59645923 59624297 1.00
tpcds_q41/datafusion:vortex-compact 21355996 20905300 1.02
tpcds_q42/datafusion:vortex-compact 24614333 24873071 0.99
tpcds_q43/datafusion:vortex-compact 38261621 37525195 1.02
tpcds_q44/datafusion:vortex-compact 76890741 76097977 1.01
tpcds_q45/datafusion:vortex-compact 38913105 39055363 1.00
tpcds_q46/datafusion:vortex-compact 69598326 71760722 0.97
tpcds_q47/datafusion:vortex-compact 229592210 231114590 0.99
tpcds_q48/datafusion:vortex-compact 91597756 90809311 1.01
tpcds_q49/datafusion:vortex-compact 93792368 91716578 1.02
tpcds_q50/datafusion:vortex-compact 65505798 64238794 1.02
tpcds_q51/datafusion:vortex-compact 104267374 99659500 1.05
tpcds_q52/datafusion:vortex-compact 24780022 24751754 1.00
tpcds_q53/datafusion:vortex-compact 37854626 36063257 1.05
tpcds_q54/datafusion:vortex-compact 60994045 60673742 1.01
tpcds_q55/datafusion:vortex-compact 25106972 24141562 1.04
tpcds_q56/datafusion:vortex-compact 56413588 55868013 1.01
tpcds_q57/datafusion:vortex-compact 139129743 136960840 1.02
tpcds_q58/datafusion:vortex-compact 82685533 78711702 1.05
tpcds_q59/datafusion:vortex-compact 85097596 85995817 0.99
tpcds_q60/datafusion:vortex-compact 56163174 55432381 1.01
tpcds_q61/datafusion:vortex-compact 73917812 73216703 1.01
tpcds_q62/datafusion:vortex-compact 34976946 32955452 1.06
tpcds_q63/datafusion:vortex-compact 36285565 36220754 1.00
tpcds_q64/datafusion:vortex-compact 549008075 542864013 1.01
tpcds_q65/datafusion:vortex-compact 68395609 69632956 0.98
tpcds_q66/datafusion:vortex-compact 99607191 101148699 0.98
tpcds_q67/datafusion:vortex-compact 130916232 127442685 1.03
tpcds_q68/datafusion:vortex-compact 71288004 71844784 0.99
tpcds_q69/datafusion:vortex-compact 63860407 62719144 1.02
tpcds_q70/datafusion:vortex-compact 125367707 121612147 1.03
tpcds_q71/datafusion:vortex-compact 47395495 47761113 0.99
tpcds_q72/datafusion:vortex-compact 2634689693 2579131303 1.02
tpcds_q73/datafusion:vortex-compact 52083169 50903345 1.02
tpcds_q74/datafusion:vortex-compact 138152712 138326600 1.00
tpcds_q75/datafusion:vortex-compact 162369411 162378849 1.00
tpcds_q76/datafusion:vortex-compact 50503786 51433523 0.98
tpcds_q77/datafusion:vortex-compact 67892417 68062962 1.00
tpcds_q78/datafusion:vortex-compact 149992526 150760844 0.99
tpcds_q79/datafusion:vortex-compact 59524196 60962579 0.98
tpcds_q80/datafusion:vortex-compact 134832318 130833265 1.03
tpcds_q81/datafusion:vortex-compact 40394210 43176768 0.94
tpcds_q82/datafusion:vortex-compact 49162662 49811219 0.99
tpcds_q83/datafusion:vortex-compact 58882150 58050971 1.01
tpcds_q84/datafusion:vortex-compact 18806006 18154318 1.04
tpcds_q85/datafusion:vortex-compact 127000399 128792920 0.99
tpcds_q86/datafusion:vortex-compact 22532150 22477153 1.00
tpcds_q87/datafusion:vortex-compact 69290573 70043020 0.99
tpcds_q88/datafusion:vortex-compact 142911815 139481209 1.02
tpcds_q89/datafusion:vortex-compact 46002281 46944668 0.98
tpcds_q90/datafusion:vortex-compact 24316245 24692523 0.98
tpcds_q91/datafusion:vortex-compact 40925086 41344816 0.99
tpcds_q92/datafusion:vortex-compact 25440351 26745118 0.95
tpcds_q93/datafusion:vortex-compact 45470685 46047683 0.99
tpcds_q94/datafusion:vortex-compact 31012600 30766178 1.01
tpcds_q95/datafusion:vortex-compact 73849122 72292697 1.02
tpcds_q96/datafusion:vortex-compact 26932096 27012932 1.00
tpcds_q97/datafusion:vortex-compact 42511680 42460564 1.00
tpcds_q98/datafusion:vortex-compact 39511149 38861284 1.02
tpcds_q99/datafusion:vortex-compact 49833123 49835434 1.00
datafusion / parquet (1.013x ➖, 1↑ 1↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 36764569 35809265 1.03
tpcds_q02/datafusion:parquet 46802379 47432220 0.99
tpcds_q03/datafusion:parquet 14923408 15872449 0.94
tpcds_q04/datafusion:parquet 320924174 318699153 1.01
tpcds_q05/datafusion:parquet 53592648 53066668 1.01
tpcds_q06/datafusion:parquet 64436038 65369566 0.99
tpcds_q07/datafusion:parquet 88676470 88066175 1.01
tpcds_q08/datafusion:parquet 33177761 31511401 1.05
tpcds_q09/datafusion:parquet 56786456 54569839 1.04
tpcds_q10/datafusion:parquet 82058404 79245171 1.04
tpcds_q11/datafusion:parquet 182191647 175755452 1.04
tpcds_q12/datafusion:parquet 22526895 21833875 1.03
tpcds_q13/datafusion:parquet 85361203 85576292 1.00
tpcds_q14/datafusion:parquet 196404454 193989375 1.01
tpcds_q15/datafusion:parquet 25860729 27907605 0.93
tpcds_q16/datafusion:parquet 28399367 29476054 0.96
tpcds_q17/datafusion:parquet 69131203 69556273 0.99
tpcds_q18/datafusion:parquet 133238335 131372639 1.01
tpcds_q19/datafusion:parquet 28249551 27882876 1.01
tpcds_q20/datafusion:parquet 21572069 20446360 1.06
tpcds_q21/datafusion:parquet 23023702 21782772 1.06
tpcds_q22/datafusion:parquet 🚀 133411272 160121107 0.83
tpcds_q23/datafusion:parquet 164460831 163147962 1.01
tpcds_q24/datafusion:parquet 105527880 108734039 0.97
tpcds_q25/datafusion:parquet 72416535 71202765 1.02
tpcds_q26/datafusion:parquet 75664243 74312894 1.02
tpcds_q27/datafusion:parquet 168530183 161060753 1.05
tpcds_q28/datafusion:parquet 49341780 48360967 1.02
tpcds_q29/datafusion:parquet 73347580 72253895 1.02
tpcds_q30/datafusion:parquet 43831281 43988836 1.00
tpcds_q31/datafusion:parquet 77926931 75576238 1.03
tpcds_q32/datafusion:parquet 22300123 22296908 1.00
tpcds_q33/datafusion:parquet 35705004 34274074 1.04
tpcds_q34/datafusion:parquet 26061677 25748485 1.01
tpcds_q35/datafusion:parquet 82156416 83145395 0.99
tpcds_q36/datafusion:parquet 65017136 63564773 1.02
tpcds_q37/datafusion:parquet 24477296 23032585 1.06
tpcds_q38/datafusion:parquet 52065592 48941133 1.06
tpcds_q39/datafusion:parquet 82616545 82941782 1.00
tpcds_q40/datafusion:parquet 27557428 28302475 0.97
tpcds_q41/datafusion:parquet 16343872 15622852 1.05
tpcds_q42/datafusion:parquet 14293112 13365454 1.07
tpcds_q43/datafusion:parquet 18749317 18328766 1.02
tpcds_q44/datafusion:parquet 41234742 42519108 0.97
tpcds_q45/datafusion:parquet 32896529 32953870 1.00
tpcds_q46/datafusion:parquet 39119111 39343414 0.99
tpcds_q47/datafusion:parquet 133923812 134697383 0.99
tpcds_q48/datafusion:parquet 78226564 80997958 0.97
tpcds_q49/datafusion:parquet 64680553 63127825 1.02
tpcds_q50/datafusion:parquet 47264852 48904983 0.97
tpcds_q51/datafusion:parquet 91988564 88230863 1.04
tpcds_q52/datafusion:parquet 14751735 13906817 1.06
tpcds_q53/datafusion:parquet 21930470 22188774 0.99
tpcds_q54/datafusion:parquet 43082183 42553965 1.01
tpcds_q55/datafusion:parquet 13829388 13865229 1.00
tpcds_q56/datafusion:parquet 35034592 35307495 0.99
tpcds_q57/datafusion:parquet 114805126 105842944 1.08
tpcds_q58/datafusion:parquet 59409731 56382363 1.05
tpcds_q59/datafusion:parquet 59620827 58501333 1.02
tpcds_q60/datafusion:parquet 35014967 35173791 1.00
tpcds_q61/datafusion:parquet 50060173 50365056 0.99
tpcds_q62/datafusion:parquet 🚨 28109318 25004203 1.12
tpcds_q63/datafusion:parquet 22483177 21868813 1.03
tpcds_q64/datafusion:parquet 550180743 544284042 1.01
tpcds_q65/datafusion:parquet 44225772 46613316 0.95
tpcds_q66/datafusion:parquet 75917005 76589061 0.99
tpcds_q67/datafusion:parquet 160655000 150163876 1.07
tpcds_q68/datafusion:parquet 41378241 40113558 1.03
tpcds_q69/datafusion:parquet 78927025 75904899 1.04
tpcds_q70/datafusion:parquet 98837959 98790171 1.00
tpcds_q71/datafusion:parquet 26558903 27120571 0.98
tpcds_q72/datafusion:parquet 641690956 631754022 1.02
tpcds_q73/datafusion:parquet 27167461 26832346 1.01
tpcds_q74/datafusion:parquet 105193655 103048614 1.02
tpcds_q75/datafusion:parquet 116841628 117667617 0.99
tpcds_q76/datafusion:parquet 37051197 34291751 1.08
tpcds_q77/datafusion:parquet 48906236 50306331 0.97
tpcds_q78/datafusion:parquet 118441289 122615894 0.97
tpcds_q79/datafusion:parquet 30340201 30118484 1.01
tpcds_q80/datafusion:parquet 92314469 90547760 1.02
tpcds_q81/datafusion:parquet 42691973 40293907 1.06
tpcds_q82/datafusion:parquet 24492415 24118640 1.02
tpcds_q83/datafusion:parquet 48106012 47553013 1.01
tpcds_q84/datafusion:parquet 48993506 49012352 1.00
tpcds_q85/datafusion:parquet 173832599 168285959 1.03
tpcds_q86/datafusion:parquet 18385262 17491504 1.05
tpcds_q87/datafusion:parquet 50516455 49555828 1.02
tpcds_q88/datafusion:parquet 69965515 69556521 1.01
tpcds_q89/datafusion:parquet 24626346 24616006 1.00
tpcds_q90/datafusion:parquet 19105766 17937206 1.07
tpcds_q91/datafusion:parquet 71178906 67871821 1.05
tpcds_q92/datafusion:parquet 21481559 21605048 0.99
tpcds_q93/datafusion:parquet 35516985 34638325 1.03
tpcds_q94/datafusion:parquet 25535532 24047459 1.06
tpcds_q95/datafusion:parquet 68349268 66539274 1.03
tpcds_q96/datafusion:parquet 15207912 14161753 1.07
tpcds_q97/datafusion:parquet 32245274 34202866 0.94
tpcds_q98/datafusion:parquet 26359389 25813664 1.02
tpcds_q99/datafusion:parquet 28919044 28401232 1.02
duckdb / vortex-file-compressed (1.023x ➖, 0↑ 4↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 21895281 23296034 0.94
tpcds_q02/duckdb:vortex-file-compressed 37095103 39603478 0.94
tpcds_q03/duckdb:vortex-file-compressed 33010344 31740886 1.04
tpcds_q04/duckdb:vortex-file-compressed 100679110 96481443 1.04
tpcds_q05/duckdb:vortex-file-compressed 34572716 33779779 1.02
tpcds_q06/duckdb:vortex-file-compressed 35029661 34544321 1.01
tpcds_q07/duckdb:vortex-file-compressed 23590664 23601379 1.00
tpcds_q08/duckdb:vortex-file-compressed 26046584 26248499 0.99
tpcds_q09/duckdb:vortex-file-compressed 39589311 39566251 1.00
tpcds_q10/duckdb:vortex-file-compressed 37826506 35741023 1.06
tpcds_q11/duckdb:vortex-file-compressed 57929807 57062674 1.02
tpcds_q12/duckdb:vortex-file-compressed 15030662 13905048 1.08
tpcds_q13/duckdb:vortex-file-compressed 32029361 31745102 1.01
tpcds_q14/duckdb:vortex-file-compressed 111509033 113852209 0.98
tpcds_q15/duckdb:vortex-file-compressed 40442351 39846958 1.01
tpcds_q16/duckdb:vortex-file-compressed 29752225 28708987 1.04
tpcds_q17/duckdb:vortex-file-compressed 35423130 35243054 1.01
tpcds_q18/duckdb:vortex-file-compressed 44494636 44196433 1.01
tpcds_q19/duckdb:vortex-file-compressed 32635824 31592458 1.03
tpcds_q20/duckdb:vortex-file-compressed 16518323 15748786 1.05
tpcds_q21/duckdb:vortex-file-compressed 20165354 20639565 0.98
tpcds_q22/duckdb:vortex-file-compressed 106986028 101717681 1.05
tpcds_q23/duckdb:vortex-file-compressed 105397065 107252850 0.98
tpcds_q24/duckdb:vortex-file-compressed 53279330 53318958 1.00
tpcds_q25/duckdb:vortex-file-compressed 34593621 34633618 1.00
tpcds_q26/duckdb:vortex-file-compressed 37421991 38764411 0.97
tpcds_q27/duckdb:vortex-file-compressed 52102901 53065483 0.98
tpcds_q28/duckdb:vortex-file-compressed 39896163 38637245 1.03
tpcds_q29/duckdb:vortex-file-compressed 34717935 33620282 1.03
tpcds_q30/duckdb:vortex-file-compressed 26459304 25054000 1.06
tpcds_q31/duckdb:vortex-file-compressed 32388216 31313831 1.03
tpcds_q32/duckdb:vortex-file-compressed 17678373 17110468 1.03
tpcds_q33/duckdb:vortex-file-compressed 24292935 24220517 1.00
tpcds_q34/duckdb:vortex-file-compressed 18650915 18723761 1.00
tpcds_q35/duckdb:vortex-file-compressed 61126864 64307816 0.95
tpcds_q36/duckdb:vortex-file-compressed 27185391 27122715 1.00
tpcds_q37/duckdb:vortex-file-compressed 🚨 25275574 21368746 1.18
tpcds_q38/duckdb:vortex-file-compressed 37669295 36307403 1.04
tpcds_q39/duckdb:vortex-file-compressed 44117924 48494235 0.91
tpcds_q40/duckdb:vortex-file-compressed 24181782 22805212 1.06
tpcds_q41/duckdb:vortex-file-compressed 14114969 13742526 1.03
tpcds_q42/duckdb:vortex-file-compressed 11983042 11248571 1.07
tpcds_q43/duckdb:vortex-file-compressed 30451525 29522377 1.03
tpcds_q44/duckdb:vortex-file-compressed 21809062 21984372 0.99
tpcds_q45/duckdb:vortex-file-compressed 29371460 28447317 1.03
tpcds_q46/duckdb:vortex-file-compressed 46793981 45467593 1.03
tpcds_q47/duckdb:vortex-file-compressed 50786499 49299017 1.03
tpcds_q48/duckdb:vortex-file-compressed 30440650 28610657 1.06
tpcds_q49/duckdb:vortex-file-compressed 31907492 30120946 1.06
tpcds_q50/duckdb:vortex-file-compressed 36157057 34438872 1.05
tpcds_q51/duckdb:vortex-file-compressed 98286553 97923953 1.00
tpcds_q52/duckdb:vortex-file-compressed 12063031 12167439 0.99
tpcds_q53/duckdb:vortex-file-compressed 19446240 19458328 1.00
tpcds_q54/duckdb:vortex-file-compressed 30119473 29421544 1.02
tpcds_q55/duckdb:vortex-file-compressed 12400436 12095147 1.03
tpcds_q56/duckdb:vortex-file-compressed 24016440 22909505 1.05
tpcds_q57/duckdb:vortex-file-compressed 43884508 43023054 1.02
tpcds_q58/duckdb:vortex-file-compressed 31072814 31821172 0.98
tpcds_q59/duckdb:vortex-file-compressed 76707197 76296835 1.01
tpcds_q60/duckdb:vortex-file-compressed 24207522 24379780 0.99
tpcds_q61/duckdb:vortex-file-compressed 37357470 36684405 1.02
tpcds_q62/duckdb:vortex-file-compressed 🚨 19273634 16168531 1.19
tpcds_q63/duckdb:vortex-file-compressed 20618685 19817515 1.04
tpcds_q64/duckdb:vortex-file-compressed 82269517 81873028 1.00
tpcds_q65/duckdb:vortex-file-compressed 22808499 22266315 1.02
tpcds_q66/duckdb:vortex-file-compressed 34220865 33174846 1.03
tpcds_q67/duckdb:vortex-file-compressed 146177406 142576563 1.03
tpcds_q68/duckdb:vortex-file-compressed 40239250 40291891 1.00
tpcds_q69/duckdb:vortex-file-compressed 37968623 36886752 1.03
tpcds_q70/duckdb:vortex-file-compressed 28579702 26946294 1.06
tpcds_q71/duckdb:vortex-file-compressed 21227245 19493438 1.09
tpcds_q72/duckdb:vortex-file-compressed 175070547 173438631 1.01
tpcds_q73/duckdb:vortex-file-compressed 19280451 18286582 1.05
tpcds_q74/duckdb:vortex-file-compressed 64338879 63663195 1.01
tpcds_q75/duckdb:vortex-file-compressed 58149881 58326777 1.00
tpcds_q76/duckdb:vortex-file-compressed 21838573 22197953 0.98
tpcds_q77/duckdb:vortex-file-compressed 26351396 26557818 0.99
tpcds_q78/duckdb:vortex-file-compressed 77484647 78829400 0.98
tpcds_q79/duckdb:vortex-file-compressed 35164217 34781718 1.01
tpcds_q80/duckdb:vortex-file-compressed 53206027 51122440 1.04
tpcds_q81/duckdb:vortex-file-compressed 28433265 27957063 1.02
tpcds_q82/duckdb:vortex-file-compressed 21762154 21811259 1.00
tpcds_q83/duckdb:vortex-file-compressed 29977513 29385717 1.02
tpcds_q84/duckdb:vortex-file-compressed 18089791 17278134 1.05
tpcds_q85/duckdb:vortex-file-compressed 46016467 45043374 1.02
tpcds_q86/duckdb:vortex-file-compressed 17236431 16679906 1.03
tpcds_q87/duckdb:vortex-file-compressed 42595565 40045201 1.06
tpcds_q88/duckdb:vortex-file-compressed 35750231 34392306 1.04
tpcds_q89/duckdb:vortex-file-compressed 20060296 19335991 1.04
tpcds_q90/duckdb:vortex-file-compressed 14001846 13371496 1.05
tpcds_q91/duckdb:vortex-file-compressed 32587942 30858021 1.06
tpcds_q92/duckdb:vortex-file-compressed 14824548 14020595 1.06
tpcds_q93/duckdb:vortex-file-compressed 🚨 29776873 26493850 1.12
tpcds_q94/duckdb:vortex-file-compressed 21044335 22375584 0.94
tpcds_q95/duckdb:vortex-file-compressed 🚨 154124375 137379124 1.12
tpcds_q96/duckdb:vortex-file-compressed 10604657 10607411 1.00
tpcds_q97/duckdb:vortex-file-compressed 37453539 36178384 1.04
tpcds_q98/duckdb:vortex-file-compressed 17982156 17406885 1.03
tpcds_q99/duckdb:vortex-file-compressed 31732096 29961086 1.06
duckdb / vortex-compact (1.011x ➖, 2↑ 1↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 25592676 24647914 1.04
tpcds_q02/duckdb:vortex-compact 54167511 56185910 0.96
tpcds_q03/duckdb:vortex-compact 58667263 59923034 0.98
tpcds_q04/duckdb:vortex-compact 114012009 107667815 1.06
tpcds_q05/duckdb:vortex-compact 39768115 37574513 1.06
tpcds_q06/duckdb:vortex-compact 38868456 38989072 1.00
tpcds_q07/duckdb:vortex-compact 37053143 35846756 1.03
tpcds_q08/duckdb:vortex-compact 35168654 34685717 1.01
tpcds_q09/duckdb:vortex-compact 57417818 58344131 0.98
tpcds_q10/duckdb:vortex-compact 47369599 47903743 0.99
tpcds_q11/duckdb:vortex-compact 62337089 65775405 0.95
tpcds_q12/duckdb:vortex-compact 19360603 21038865 0.92
tpcds_q13/duckdb:vortex-compact 48950545 47110739 1.04
tpcds_q14/duckdb:vortex-compact 124653317 122786088 1.02
tpcds_q15/duckdb:vortex-compact 45735414 44825902 1.02
tpcds_q16/duckdb:vortex-compact 34789088 33070905 1.05
tpcds_q17/duckdb:vortex-compact 47669867 48276062 0.99
tpcds_q18/duckdb:vortex-compact 56790101 57430231 0.99
tpcds_q19/duckdb:vortex-compact 40260254 39534576 1.02
tpcds_q20/duckdb:vortex-compact 21028209 20506131 1.03
tpcds_q21/duckdb:vortex-compact 28014757 26736192 1.05
tpcds_q22/duckdb:vortex-compact 113378791 112065957 1.01
tpcds_q23/duckdb:vortex-compact 105446872 102705034 1.03
tpcds_q24/duckdb:vortex-compact 68339903 67095623 1.02
tpcds_q25/duckdb:vortex-compact 49441558 47597069 1.04
tpcds_q26/duckdb:vortex-compact 🚀 47185850 54086177 0.87
tpcds_q27/duckdb:vortex-compact 67263825 65330203 1.03
tpcds_q28/duckdb:vortex-compact 86713516 85478179 1.01
tpcds_q29/duckdb:vortex-compact 48270294 49322142 0.98
tpcds_q30/duckdb:vortex-compact 29520381 30100905 0.98
tpcds_q31/duckdb:vortex-compact 35489615 35506850 1.00
tpcds_q32/duckdb:vortex-compact 24240829 23550694 1.03
tpcds_q33/duckdb:vortex-compact 30720228 31127316 0.99
tpcds_q34/duckdb:vortex-compact 26039766 25129297 1.04
tpcds_q35/duckdb:vortex-compact 72740838 67350385 1.08
tpcds_q36/duckdb:vortex-compact 36209881 35359767 1.02
tpcds_q37/duckdb:vortex-compact 30327809 32304032 0.94
tpcds_q38/duckdb:vortex-compact 41584492 42650143 0.98
tpcds_q39/duckdb:vortex-compact 52962115 52826177 1.00
tpcds_q40/duckdb:vortex-compact 27942817 28815330 0.97
tpcds_q41/duckdb:vortex-compact 🚨 18516236 16484355 1.12
tpcds_q42/duckdb:vortex-compact 16642904 16141244 1.03
tpcds_q43/duckdb:vortex-compact 39070269 38558935 1.01
tpcds_q44/duckdb:vortex-compact 32266999 31926030 1.01
tpcds_q45/duckdb:vortex-compact 32135534 31379146 1.02
tpcds_q46/duckdb:vortex-compact 58471635 56709739 1.03
tpcds_q47/duckdb:vortex-compact 58458003 56039330 1.04
tpcds_q48/duckdb:vortex-compact 41404652 40731681 1.02
tpcds_q49/duckdb:vortex-compact 44295230 43294725 1.02
tpcds_q50/duckdb:vortex-compact 48054405 47977893 1.00
tpcds_q51/duckdb:vortex-compact 105241400 103498838 1.02
tpcds_q52/duckdb:vortex-compact 17286127 17500162 0.99
tpcds_q53/duckdb:vortex-compact 28068819 27708496 1.01
tpcds_q54/duckdb:vortex-compact 35299357 36577111 0.97
tpcds_q55/duckdb:vortex-compact 17412590 16869799 1.03
tpcds_q56/duckdb:vortex-compact 30070383 31698897 0.95
tpcds_q57/duckdb:vortex-compact 48698961 46871346 1.04
tpcds_q58/duckdb:vortex-compact 45577995 46033185 0.99
tpcds_q59/duckdb:vortex-compact 100292405 97276201 1.03
tpcds_q60/duckdb:vortex-compact 31346186 31428575 1.00
tpcds_q61/duckdb:vortex-compact 51894645 52417781 0.99
tpcds_q62/duckdb:vortex-compact 20576854 20125806 1.02
tpcds_q63/duckdb:vortex-compact 28472325 28222889 1.01
tpcds_q64/duckdb:vortex-compact 100082144 102374102 0.98
tpcds_q65/duckdb:vortex-compact 30410094 29970529 1.01
tpcds_q66/duckdb:vortex-compact 40427813 38024242 1.06
tpcds_q67/duckdb:vortex-compact 154705207 150740987 1.03
tpcds_q68/duckdb:vortex-compact 52549975 50853810 1.03
tpcds_q69/duckdb:vortex-compact 48779058 48278518 1.01
tpcds_q70/duckdb:vortex-compact 36280766 35148319 1.03
tpcds_q71/duckdb:vortex-compact 27578285 26822582 1.03
tpcds_q72/duckdb:vortex-compact 195157795 192618495 1.01
tpcds_q73/duckdb:vortex-compact 25643070 25655098 1.00
tpcds_q74/duckdb:vortex-compact 68637031 67213793 1.02
tpcds_q75/duckdb:vortex-compact 69322086 67564396 1.03
tpcds_q76/duckdb:vortex-compact 41239722 39466192 1.04
tpcds_q77/duckdb:vortex-compact 36731852 37491852 0.98
tpcds_q78/duckdb:vortex-compact 85926920 84206739 1.02
tpcds_q79/duckdb:vortex-compact 58234122 57030227 1.02
tpcds_q80/duckdb:vortex-compact 66048858 67768333 0.97
tpcds_q81/duckdb:vortex-compact 33855908 33424815 1.01
tpcds_q82/duckdb:vortex-compact 31342862 33375678 0.94
tpcds_q83/duckdb:vortex-compact 47831589 44643368 1.07
tpcds_q84/duckdb:vortex-compact 22371399 22102996 1.01
tpcds_q85/duckdb:vortex-compact 58800177 58865005 1.00
tpcds_q86/duckdb:vortex-compact 🚀 20283611 22539676 0.90
tpcds_q87/duckdb:vortex-compact 44012092 41988139 1.05
tpcds_q88/duckdb:vortex-compact 41350939 39980944 1.03
tpcds_q89/duckdb:vortex-compact 27524500 26751104 1.03
tpcds_q90/duckdb:vortex-compact 16337243 15670010 1.04
tpcds_q91/duckdb:vortex-compact 51976326 52804206 0.98
tpcds_q92/duckdb:vortex-compact 20564207 19934615 1.03
tpcds_q93/duckdb:vortex-compact 33164871 31824237 1.04
tpcds_q94/duckdb:vortex-compact 25785389 25238862 1.02
tpcds_q95/duckdb:vortex-compact 147862682 137189769 1.08
tpcds_q96/duckdb:vortex-compact 13323478 13236174 1.01
tpcds_q97/duckdb:vortex-compact 44104761 41058443 1.07
tpcds_q98/duckdb:vortex-compact 24801063 24470203 1.01
tpcds_q99/duckdb:vortex-compact 33381277 32588584 1.02
duckdb / parquet (1.007x ➖, 0↑ 2↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 27314496 29768835 0.92
tpcds_q02/duckdb:parquet 23724209 24335562 0.97
tpcds_q03/duckdb:parquet 11512566 11206582 1.03
tpcds_q04/duckdb:parquet 165172629 170099946 0.97
tpcds_q05/duckdb:parquet 29011489 29806958 0.97
tpcds_q06/duckdb:parquet 28386193 27772365 1.02
tpcds_q07/duckdb:parquet 20946133 21033216 1.00
tpcds_q08/duckdb:parquet 27867220 26641038 1.05
tpcds_q09/duckdb:parquet 39071161 39501523 0.99
tpcds_q10/duckdb:parquet 33136308 32813054 1.01
tpcds_q11/duckdb:parquet 85327108 89814461 0.95
tpcds_q12/duckdb:parquet 14396783 14367598 1.00
tpcds_q13/duckdb:parquet 32255516 33809226 0.95
tpcds_q14/duckdb:parquet 99080694 102241964 0.97
tpcds_q15/duckdb:parquet 30675581 29247164 1.05
tpcds_q16/duckdb:parquet 21057761 21577794 0.98
tpcds_q17/duckdb:parquet 38639034 36509927 1.06
tpcds_q18/duckdb:parquet 45857847 45752173 1.00
tpcds_q19/duckdb:parquet 27622973 29820818 0.93
tpcds_q20/duckdb:parquet 15167872 15686299 0.97
tpcds_q21/duckdb:parquet 10868141 10213226 1.06
tpcds_q22/duckdb:parquet 70648233 66068044 1.07
tpcds_q23/duckdb:parquet 79864809 79783229 1.00
tpcds_q24/duckdb:parquet 44972246 44054055 1.02
tpcds_q25/duckdb:parquet 32637814 32937560 0.99
tpcds_q26/duckdb:parquet 35092516 33616419 1.04
tpcds_q27/duckdb:parquet 49878442 47914622 1.04
tpcds_q28/duckdb:parquet 37715492 37308981 1.01
tpcds_q29/duckdb:parquet 🚨 36908685 33066157 1.12
tpcds_q30/duckdb:parquet 34640828 35424140 0.98
tpcds_q31/duckdb:parquet 23709120 23354709 1.02
tpcds_q32/duckdb:parquet 11099786 11040656 1.01
tpcds_q33/duckdb:parquet 20335731 21677814 0.94
tpcds_q34/duckdb:parquet 20194752 19809486 1.02
tpcds_q35/duckdb:parquet 55271060 55004381 1.00
tpcds_q36/duckdb:parquet 20122926 19665721 1.02
tpcds_q37/duckdb:parquet 12327180 11732137 1.05
tpcds_q38/duckdb:parquet 32539776 33359448 0.98
tpcds_q39/duckdb:parquet 28769375 30133737 0.95
tpcds_q40/duckdb:parquet 17204761 17160251 1.00
tpcds_q41/duckdb:parquet 7755475 7622378 1.02
tpcds_q42/duckdb:parquet 9352986 9424636 0.99
tpcds_q43/duckdb:parquet 15325672 15453102 0.99
tpcds_q44/duckdb:parquet 21910201 22458015 0.98
tpcds_q45/duckdb:parquet 26005436 25829366 1.01
tpcds_q46/duckdb:parquet 44168546 45134934 0.98
tpcds_q47/duckdb:parquet 45985902 44061611 1.04
tpcds_q48/duckdb:parquet 29557897 29296596 1.01
tpcds_q49/duckdb:parquet 25362162 24286041 1.04
tpcds_q50/duckdb:parquet 23970209 23173090 1.03
tpcds_q51/duckdb:parquet 95148678 96510794 0.99
tpcds_q52/duckdb:parquet 10027677 10494318 0.96
tpcds_q53/duckdb:parquet 15143981 15077404 1.00
tpcds_q54/duckdb:parquet 25050558 25526642 0.98
tpcds_q55/duckdb:parquet 10083174 9539168 1.06
tpcds_q56/duckdb:parquet 20222553 20321063 1.00
tpcds_q57/duckdb:parquet 34974167 34966008 1.00
tpcds_q58/duckdb:parquet 21801992 21191052 1.03
tpcds_q59/duckdb:parquet 35269990 35197417 1.00
tpcds_q60/duckdb:parquet 22077287 21384824 1.03
tpcds_q61/duckdb:parquet 30181984 30650483 0.98
tpcds_q62/duckdb:parquet 11941497 11617779 1.03
tpcds_q63/duckdb:parquet 14592246 14207736 1.03
tpcds_q64/duckdb:parquet 72889193 73480924 0.99
tpcds_q65/duckdb:parquet 19701453 20891565 0.94
tpcds_q66/duckdb:parquet 29122549 27429565 1.06
tpcds_q67/duckdb:parquet 132138987 132917757 0.99
tpcds_q68/duckdb:parquet 36691752 36514695 1.00
tpcds_q69/duckdb:parquet 35844233 35770952 1.00
tpcds_q70/duckdb:parquet 19531394 19463669 1.00
tpcds_q71/duckdb:parquet 19505369 18986038 1.03
tpcds_q72/duckdb:parquet 164127951 165167145 0.99
tpcds_q73/duckdb:parquet 17223106 17917813 0.96
tpcds_q74/duckdb:parquet 129306412 128134177 1.01
tpcds_q75/duckdb:parquet 53135445 51447285 1.03
tpcds_q76/duckdb:parquet 19047800 19145439 0.99
tpcds_q77/duckdb:parquet 21486480 22027386 0.98
tpcds_q78/duckdb:parquet 73752154 72323346 1.02
tpcds_q79/duckdb:parquet 27579115 27223901 1.01
tpcds_q80/duckdb:parquet 41142931 39533124 1.04
tpcds_q81/duckdb:parquet 31496521 30955620 1.02
tpcds_q82/duckdb:parquet 13525197 12946882 1.04
tpcds_q83/duckdb:parquet 16779574 17334068 0.97
tpcds_q84/duckdb:parquet 18866798 17958544 1.05
tpcds_q85/duckdb:parquet 38389474 37816980 1.02
tpcds_q86/duckdb:parquet 12165457 12292238 0.99
tpcds_q87/duckdb:parquet 35244288 37930810 0.93
tpcds_q88/duckdb:parquet 48761759 48351404 1.01
tpcds_q89/duckdb:parquet 16253248 16410729 0.99
tpcds_q90/duckdb:parquet 7400129 7208925 1.03
tpcds_q91/duckdb:parquet 22553948 22750700 0.99
tpcds_q92/duckdb:parquet 11852867 11126202 1.07
tpcds_q93/duckdb:parquet 29086614 27426385 1.06
tpcds_q94/duckdb:parquet 16853428 15443522 1.09
tpcds_q95/duckdb:parquet 🚨 145022430 130842277 1.11
tpcds_q96/duckdb:parquet 8722182 8860416 0.98
tpcds_q97/duckdb:parquet 35738312 34311264 1.04
tpcds_q98/duckdb:parquet 17548526 17433728 1.01
tpcds_q99/duckdb:parquet 20458226 19193519 1.07
duckdb / duckdb (1.012x ➖, 1↑ 1↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 19681517 20120631 0.98
tpcds_q02/duckdb:duckdb 17998208 18440067 0.98
tpcds_q03/duckdb:duckdb 8485030 8098530 1.05
tpcds_q04/duckdb:duckdb 175445981 172532922 1.02
tpcds_q05/duckdb:duckdb 18721162 19355497 0.97
tpcds_q06/duckdb:duckdb 🚨 24963706 22127841 1.13
tpcds_q07/duckdb:duckdb 37949015 39199854 0.97
tpcds_q08/duckdb:duckdb 123657975 119875466 1.03
tpcds_q09/duckdb:duckdb 19620186 19449418 1.01
tpcds_q10/duckdb:duckdb 23134946 23154977 1.00
tpcds_q11/duckdb:duckdb 90695748 90216505 1.01
tpcds_q12/duckdb:duckdb 11251286 10982233 1.02
tpcds_q13/duckdb:duckdb 23795757 23683429 1.00
tpcds_q14/duckdb:duckdb 89971028 90788073 0.99
tpcds_q15/duckdb:duckdb 24188158 24010245 1.01
tpcds_q16/duckdb:duckdb 18768790 17952218 1.05
tpcds_q17/duckdb:duckdb 21904239 21135929 1.04
tpcds_q18/duckdb:duckdb 44452954 43027787 1.03
tpcds_q19/duckdb:duckdb 16538807 17240587 0.96
tpcds_q20/duckdb:duckdb 12211879 12161187 1.00
tpcds_q21/duckdb:duckdb 6778780 6961395 0.97
tpcds_q22/duckdb:duckdb 62187348 61986102 1.00
tpcds_q23/duckdb:duckdb 73627060 72664277 1.01
tpcds_q24/duckdb:duckdb 23263779 22634928 1.03
tpcds_q25/duckdb:duckdb 16715170 16740051 1.00
tpcds_q26/duckdb:duckdb 26815193 25358931 1.06
tpcds_q27/duckdb:duckdb 39954066 38786317 1.03
tpcds_q28/duckdb:duckdb 21525995 21159671 1.02
tpcds_q29/duckdb:duckdb 19783826 19950391 0.99
tpcds_q30/duckdb:duckdb 28355236 27441554 1.03
tpcds_q31/duckdb:duckdb 46157526 45333854 1.02
tpcds_q32/duckdb:duckdb 7568062 7503906 1.01
tpcds_q33/duckdb:duckdb 12406535 12219613 1.02
tpcds_q34/duckdb:duckdb 15029283 14986229 1.00
tpcds_q35/duckdb:duckdb 33152075 30409078 1.09
tpcds_q36/duckdb:duckdb 66062618 69495779 0.95
tpcds_q37/duckdb:duckdb 7234395 7313799 0.99
tpcds_q38/duckdb:duckdb 30810965 33574419 0.92
tpcds_q39/duckdb:duckdb 24387604 25408035 0.96
tpcds_q40/duckdb:duckdb 13143561 13012977 1.01
tpcds_q41/duckdb:duckdb 7880637 7851618 1.00
tpcds_q42/duckdb:duckdb 6350911 6290779 1.01
tpcds_q43/duckdb:duckdb 11020537 11205375 0.98
tpcds_q44/duckdb:duckdb 13577081 12602818 1.08
tpcds_q45/duckdb:duckdb 16088656 17307485 0.93
tpcds_q46/duckdb:duckdb 36066793 35644563 1.01
tpcds_q47/duckdb:duckdb 40349454 41077785 0.98
tpcds_q48/duckdb:duckdb 21672684 21118198 1.03
tpcds_q49/duckdb:duckdb 16357018 16757610 0.98
tpcds_q50/duckdb:duckdb 14461507 13687031 1.06
tpcds_q51/duckdb:duckdb 91792265 92704920 0.99
tpcds_q52/duckdb:duckdb 7511385 7095528 1.06
tpcds_q53/duckdb:duckdb 12768086 12749781 1.00
tpcds_q54/duckdb:duckdb 16819033 16905511 0.99
tpcds_q55/duckdb:duckdb 7038802 6736480 1.04
tpcds_q56/duckdb:duckdb 13565659 12618646 1.08
tpcds_q57/duckdb:duckdb 32394738 31442263 1.03
tpcds_q58/duckdb:duckdb 12633120 12380989 1.02
tpcds_q59/duckdb:duckdb 34844911 35105344 0.99
tpcds_q60/duckdb:duckdb 14727763 13885833 1.06
tpcds_q61/duckdb:duckdb 13898424 13861490 1.00
tpcds_q62/duckdb:duckdb 9246371 9094589 1.02
tpcds_q63/duckdb:duckdb 11798555 11836262 1.00
tpcds_q64/duckdb:duckdb 51426163 51458880 1.00
tpcds_q65/duckdb:duckdb 34610605 32211346 1.07
tpcds_q66/duckdb:duckdb 25416415 24338803 1.04
tpcds_q67/duckdb:duckdb 127803421 127203243 1.00
tpcds_q68/duckdb:duckdb 24760124 24922352 0.99
tpcds_q69/duckdb:duckdb 24102744 24028295 1.00
tpcds_q70/duckdb:duckdb 13880015 13604267 1.02
tpcds_q71/duckdb:duckdb 11670520 11518062 1.01
tpcds_q72/duckdb:duckdb 42641062 42093408 1.01
tpcds_q73/duckdb:duckdb 10865116 10159887 1.07
tpcds_q74/duckdb:duckdb 147571267 144745995 1.02
tpcds_q75/duckdb:duckdb 43274347 42881364 1.01
tpcds_q76/duckdb:duckdb 12274233 11382244 1.08
tpcds_q77/duckdb:duckdb 12060005 11259951 1.07
tpcds_q78/duckdb:duckdb 63842332 62789187 1.02
tpcds_q79/duckdb:duckdb 18324565 17985811 1.02
tpcds_q80/duckdb:duckdb 27369562 26980209 1.01
tpcds_q81/duckdb:duckdb 35843429 36355497 0.99
tpcds_q82/duckdb:duckdb 8526253 8203385 1.04
tpcds_q83/duckdb:duckdb 9218818 9113889 1.01
tpcds_q84/duckdb:duckdb 13266922 13466725 0.99
tpcds_q85/duckdb:duckdb 24024631 23386475 1.03
tpcds_q86/duckdb:duckdb 10446394 10412310 1.00
tpcds_q87/duckdb:duckdb 34594867 32234476 1.07
tpcds_q88/duckdb:duckdb 25072660 24595578 1.02
tpcds_q89/duckdb:duckdb 14403679 14197898 1.01
tpcds_q90/duckdb:duckdb 5498540 5358663 1.03
tpcds_q91/duckdb:duckdb 12354441 13004672 0.95
tpcds_q92/duckdb:duckdb 9182663 8671801 1.06
tpcds_q93/duckdb:duckdb 21941650 21524319 1.02
tpcds_q94/duckdb:duckdb 12495833 12748845 0.98
tpcds_q95/duckdb:duckdb 🚀 109287155 127135537 0.86
tpcds_q96/duckdb:duckdb 4595841 4477293 1.03
tpcds_q97/duckdb:duckdb 29983791 30411819 0.99
tpcds_q98/duckdb:duckdb 13257358 13288275 1.00
tpcds_q99/duckdb:duckdb 15978696 16019895 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +2.9% -2.9% +6.0% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +1.3% -2.9% +4.3% +12.5% ➖ noise
1 duckdb:duckdb -2.2% -2.9% +0.8% +11.4% ➖ noise
1 duckdb:vortex-compact +3.8% -2.9% +7.0% +11.6% ➖ noise
1 duckdb:vortex-file-compressed -6.0% -2.9% -3.2% +10.0% ➖ noise
2 datafusion:vortex-compact +1.7% -1.9% +3.7% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +1.7% -1.9% +3.7% +10.0% ➖ noise
2 duckdb:duckdb -2.4% -1.9% -0.5% +10.0% ➖ noise
2 duckdb:vortex-compact -3.6% -1.9% -1.7% +25.4% ➖ noise
2 duckdb:vortex-file-compressed -6.3% -1.9% -4.5% +34.1% ➖ noise
3 datafusion:vortex-compact +3.5% -1.7% +5.3% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +2.6% -1.7% +4.4% +10.0% ➖ noise
3 duckdb:duckdb +4.8% -1.7% +6.6% +17.7% ➖ noise
3 duckdb:vortex-compact -2.1% -1.7% -0.4% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +4.0% -1.7% +5.8% +10.0% ➖ noise
4 datafusion:vortex-compact +1.9% -1.1% +3.1% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +2.5% -1.1% +3.7% +10.0% ➖ noise
4 duckdb:duckdb +1.7% -1.1% +2.8% +10.0% ➖ noise
4 duckdb:vortex-compact +5.9% -1.1% +7.1% +12.7% ➖ noise
4 duckdb:vortex-file-compressed +4.4% -1.1% +5.5% +12.0% ➖ noise
5 datafusion:vortex-compact -2.4% -0.9% -1.5% +10.2% ➖ noise
5 datafusion:vortex-file-compressed -3.4% -0.9% -2.6% +12.0% ➖ noise
5 duckdb:duckdb -3.3% -0.9% -2.4% +15.0% ➖ noise
5 duckdb:vortex-compact +5.8% -0.9% +6.8% +11.2% ➖ noise
5 duckdb:vortex-file-compressed +2.3% -0.9% +3.2% +11.6% ➖ noise
6 datafusion:vortex-compact -1.0% +0.4% -1.3% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +2.8% +0.4% +2.4% +10.0% ➖ noise
6 duckdb:duckdb +12.8% +0.4% +12.4% +15.2% ➖ noise
6 duckdb:vortex-compact -0.3% +0.4% -0.7% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +1.4% +0.4% +1.0% +10.0% ➖ noise
7 datafusion:vortex-compact -1.4% +0.1% -1.6% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +5.6% +0.1% +5.4% +10.0% ➖ noise
7 duckdb:duckdb -3.2% +0.1% -3.3% +16.8% ➖ noise
7 duckdb:vortex-compact +3.4% +0.1% +3.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -0.0% +0.1% -0.2% +10.5% ➖ noise
8 datafusion:vortex-compact +1.0% +4.9% -3.8% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +0.6% +4.9% -4.1% +10.0% ➖ noise
8 duckdb:duckdb +3.2% +4.9% -1.7% +10.0% ➖ noise
8 duckdb:vortex-compact +1.4% +4.9% -3.4% +11.3% ➖ noise
8 duckdb:vortex-file-compressed -0.8% +4.9% -5.4% +10.5% ➖ noise
9 datafusion:vortex-compact -1.0% +1.5% -2.4% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -0.0% +1.5% -1.4% +10.0% ➖ noise
9 duckdb:duckdb +0.9% +1.5% -0.6% +10.0% ➖ noise
9 duckdb:vortex-compact -1.6% +1.5% -3.0% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.1% +1.5% -1.4% +10.0% ➖ noise
10 datafusion:vortex-compact -0.2% +2.3% -2.4% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -0.5% +2.3% -2.7% +10.0% ➖ noise
10 duckdb:duckdb -0.1% +2.3% -2.3% +11.0% ➖ noise
10 duckdb:vortex-compact -1.1% +2.3% -3.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +5.8% +2.3% +3.5% +11.0% ➖ noise
11 datafusion:vortex-compact -0.2% -0.8% +0.5% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -2.1% -0.8% -1.4% +10.0% ➖ noise
11 duckdb:duckdb +0.5% -0.8% +1.3% +10.6% ➖ noise
11 duckdb:vortex-compact -5.2% -0.8% -4.5% +15.9% ➖ noise
11 duckdb:vortex-file-compressed +1.5% -0.8% +2.3% +13.8% ➖ noise
12 datafusion:vortex-compact -3.8% +1.7% -5.4% +11.3% ➖ noise
12 datafusion:vortex-file-compressed +1.5% +1.7% -0.2% +14.6% ➖ noise
12 duckdb:duckdb +2.4% +1.7% +0.8% +12.0% ➖ noise
12 duckdb:vortex-compact -8.0% +1.7% -9.5% +14.7% ➖ noise
12 duckdb:vortex-file-compressed +8.1% +1.7% +6.3% +10.5% ➖ noise
13 datafusion:vortex-compact +4.1% -2.4% +6.7% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -1.1% -2.4% +1.4% +10.0% ➖ noise
13 duckdb:duckdb +0.5% -2.4% +3.0% +10.0% ➖ noise
13 duckdb:vortex-compact +3.9% -2.4% +6.5% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +0.9% -2.4% +3.4% +13.5% ➖ noise
14 datafusion:vortex-compact -0.9% -0.9% +0.1% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +2.3% -0.9% +3.3% +10.0% ➖ noise
14 duckdb:duckdb -0.9% -0.9% +0.0% +10.0% ➖ noise
14 duckdb:vortex-compact +1.5% -0.9% +2.5% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -2.1% -0.9% -1.1% +10.0% ➖ noise
15 datafusion:vortex-compact +1.2% -1.4% +2.7% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +8.4% -1.4% +9.9% +16.2% ➖ noise
15 duckdb:duckdb +0.7% -1.4% +2.2% +12.9% ➖ noise
15 duckdb:vortex-compact +2.0% -1.4% +3.5% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +1.5% -1.4% +3.0% +10.0% ➖ noise
16 datafusion:vortex-compact +2.2% -3.0% +5.4% +11.1% ➖ noise
16 datafusion:vortex-file-compressed -1.2% -3.0% +1.9% +10.8% ➖ noise
16 duckdb:duckdb +4.5% -3.0% +7.8% +19.9% ➖ noise
16 duckdb:vortex-compact +5.2% -3.0% +8.5% +13.8% ➖ noise
16 duckdb:vortex-file-compressed +3.6% -3.0% +6.9% +10.6% ➖ noise
17 datafusion:vortex-compact +0.8% +2.6% -1.7% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +0.2% +2.6% -2.3% +10.0% ➖ noise
17 duckdb:duckdb +3.6% +2.6% +1.0% +10.0% ➖ noise
17 duckdb:vortex-compact -1.3% +2.6% -3.7% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +0.5% +2.6% -2.0% +10.0% ➖ noise
18 datafusion:vortex-compact +0.5% +0.8% -0.3% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +3.7% +0.8% +2.8% +10.0% ➖ noise
18 duckdb:duckdb +3.3% +0.8% +2.5% +10.0% ➖ noise
18 duckdb:vortex-compact -1.1% +0.8% -1.9% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +0.7% +0.8% -0.1% +10.0% ➖ noise
19 datafusion:vortex-compact +1.9% -3.1% +5.2% +11.4% ➖ noise
19 datafusion:vortex-file-compressed +0.1% -3.1% +3.4% +12.2% ➖ noise
19 duckdb:duckdb -4.1% -3.1% -1.0% +14.4% ➖ noise
19 duckdb:vortex-compact +1.8% -3.1% +5.1% +11.6% ➖ noise
19 duckdb:vortex-file-compressed +3.3% -3.1% +6.6% +14.0% ➖ noise
20 datafusion:vortex-compact -1.9% +1.0% -2.9% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -1.3% +1.0% -2.3% +10.0% ➖ noise
20 duckdb:duckdb +0.4% +1.0% -0.6% +13.0% ➖ noise
20 duckdb:vortex-compact +2.5% +1.0% +1.5% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +4.9% +1.0% +3.8% +10.0% ➖ noise
21 datafusion:vortex-compact +2.7% +6.1% -3.2% +13.1% ➖ noise
21 datafusion:vortex-file-compressed +0.5% +6.1% -5.3% +12.3% ➖ noise
21 duckdb:duckdb -2.6% +6.1% -8.2% +18.3% ➖ noise
21 duckdb:vortex-compact +4.8% +6.1% -1.2% +17.0% ➖ noise
21 duckdb:vortex-file-compressed -2.3% +6.1% -7.9% +16.9% ➖ noise
22 datafusion:vortex-compact -1.1% -5.6% +4.8% +12.0% ➖ noise
22 datafusion:vortex-file-compressed +1.1% -5.6% +7.1% +12.0% ➖ noise
22 duckdb:duckdb +0.3% -5.6% +6.3% +11.3% ➖ noise
22 duckdb:vortex-compact +1.2% -5.6% +7.2% +10.7% ➖ noise
22 duckdb:vortex-file-compressed +5.2% -5.6% +11.4% +11.1% 🚨 regression
23 datafusion:vortex-compact +2.9% +0.5% +2.4% +10.0% ➖ noise
23 datafusion:vortex-file-compressed +0.9% +0.5% +0.4% +10.0% ➖ noise
23 duckdb:duckdb +1.3% +0.5% +0.9% +13.4% ➖ noise
23 duckdb:vortex-compact +2.7% +0.5% +2.2% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -1.7% +0.5% -2.2% +10.0% ➖ noise
24 datafusion:vortex-compact +1.9% -0.5% +2.3% +10.0% ➖ noise
24 datafusion:vortex-file-compressed +2.4% -0.5% +2.9% +10.0% ➖ noise
24 duckdb:duckdb +2.8% -0.5% +3.3% +26.8% ➖ noise
24 duckdb:vortex-compact +1.9% -0.5% +2.3% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -0.1% -0.5% +0.4% +14.0% ➖ noise
25 datafusion:vortex-compact +0.0% +0.4% -0.4% +10.0% ➖ noise
25 datafusion:vortex-file-compressed +1.4% +0.4% +1.0% +10.0% ➖ noise
25 duckdb:duckdb -0.1% +0.4% -0.5% +10.0% ➖ noise
25 duckdb:vortex-compact +3.9% +0.4% +3.5% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -0.1% +0.4% -0.5% +10.0% ➖ noise
26 datafusion:vortex-compact -0.7% +3.1% -3.7% +10.0% ➖ noise
26 datafusion:vortex-file-compressed -2.3% +3.1% -5.2% +13.2% ➖ noise
26 duckdb:duckdb +5.7% +3.1% +2.6% +15.2% ➖ noise
26 duckdb:vortex-compact -12.8% +3.1% -15.4% +15.2% ✅ faster
26 duckdb:vortex-file-compressed -3.5% +3.1% -6.4% +16.5% ➖ noise
27 datafusion:vortex-compact +0.8% +4.4% -3.5% +10.0% ➖ noise
27 datafusion:vortex-file-compressed -0.4% +4.4% -4.5% +10.0% ➖ noise
27 duckdb:duckdb +3.0% +4.4% -1.3% +19.2% ➖ noise
27 duckdb:vortex-compact +3.0% +4.4% -1.3% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -1.8% +4.4% -5.9% +12.5% ➖ noise
28 datafusion:vortex-compact +1.4% +1.6% -0.2% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +1.1% +1.6% -0.5% +10.0% ➖ noise
28 duckdb:duckdb +1.7% +1.6% +0.2% +17.9% ➖ noise
28 duckdb:vortex-compact +1.4% +1.6% -0.1% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +3.3% +1.6% +1.7% +10.0% ➖ noise
29 datafusion:vortex-compact +0.1% +6.4% -6.0% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +2.2% +6.4% -4.0% +10.0% ➖ noise
29 duckdb:duckdb -0.8% +6.4% -6.8% +10.7% ➖ noise
29 duckdb:vortex-compact -2.1% +6.4% -8.1% +10.6% ➖ noise
29 duckdb:vortex-file-compressed +3.3% +6.4% -3.0% +10.7% ➖ noise
30 datafusion:vortex-compact +2.4% -1.3% +3.7% +10.0% ➖ noise
30 datafusion:vortex-file-compressed -1.5% -1.3% -0.2% +10.0% ➖ noise
30 duckdb:duckdb +3.3% -1.3% +4.7% +13.2% ➖ noise
30 duckdb:vortex-compact -1.9% -1.3% -0.6% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +5.6% -1.3% +7.0% +15.0% ➖ noise
31 datafusion:vortex-compact +2.5% +2.3% +0.2% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +1.6% +2.3% -0.7% +10.0% ➖ noise
31 duckdb:duckdb +1.8% +2.3% -0.5% +11.2% ➖ noise
31 duckdb:vortex-compact -0.0% +2.3% -2.3% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +3.4% +2.3% +1.1% +10.0% ➖ noise
32 datafusion:vortex-compact +7.7% +0.3% +7.4% +10.4% ➖ noise
32 datafusion:vortex-file-compressed +5.7% +0.3% +5.4% +10.6% ➖ noise
32 duckdb:duckdb +0.9% +0.3% +0.6% +11.6% ➖ noise
32 duckdb:vortex-compact +2.9% +0.3% +2.6% +11.6% ➖ noise
32 duckdb:vortex-file-compressed +3.3% +0.3% +3.0% +11.2% ➖ noise
33 datafusion:vortex-compact +0.6% -1.1% +1.8% +10.7% ➖ noise
33 datafusion:vortex-file-compressed +2.8% -1.1% +4.0% +10.8% ➖ noise
33 duckdb:duckdb +1.5% -1.1% +2.7% +10.1% ➖ noise
33 duckdb:vortex-compact -1.3% -1.1% -0.2% +10.9% ➖ noise
33 duckdb:vortex-file-compressed +0.3% -1.1% +1.5% +11.3% ➖ noise
34 datafusion:vortex-compact -0.4% +1.6% -2.0% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +0.4% +1.6% -1.2% +10.0% ➖ noise
34 duckdb:duckdb +0.3% +1.6% -1.3% +10.4% ➖ noise
34 duckdb:vortex-compact +3.6% +1.6% +2.0% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -0.4% +1.6% -1.9% +10.0% ➖ noise
35 datafusion:vortex-compact +0.6% -0.4% +1.0% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -0.6% -0.4% -0.2% +10.0% ➖ noise
35 duckdb:duckdb +9.0% -0.4% +9.4% +14.5% ➖ noise
35 duckdb:vortex-compact +8.0% -0.4% +8.4% +11.8% ➖ noise
35 duckdb:vortex-file-compressed -4.9% -0.4% -4.6% +14.0% ➖ noise
36 datafusion:vortex-compact +2.9% +2.3% +0.6% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +0.9% +2.3% -1.4% +10.0% ➖ noise
36 duckdb:duckdb -4.9% +2.3% -7.1% +11.3% ➖ noise
36 duckdb:vortex-compact +2.4% +2.3% +0.1% +10.0% ➖ noise
36 duckdb:vortex-file-compressed +0.2% +2.3% -2.0% +10.0% ➖ noise
37 datafusion:vortex-compact +1.3% +5.7% -4.1% +11.4% ➖ noise
37 datafusion:vortex-file-compressed +5.2% +5.7% -0.4% +10.0% ➖ noise
37 duckdb:duckdb -1.1% +5.7% -6.4% +17.0% ➖ noise
37 duckdb:vortex-compact -6.1% +5.7% -11.2% +10.0% ✅ faster
37 duckdb:vortex-file-compressed +18.3% +5.7% +11.9% +16.6% ➖ noise
38 datafusion:vortex-compact +2.1% +1.9% +0.3% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -0.8% +1.9% -2.6% +10.0% ➖ noise
38 duckdb:duckdb -8.2% +1.9% -9.9% +12.4% ➖ noise
38 duckdb:vortex-compact -2.5% +1.9% -4.3% +20.1% ➖ noise
38 duckdb:vortex-file-compressed +3.8% +1.9% +1.8% +16.5% ➖ noise
39 datafusion:vortex-compact +3.2% -2.5% +5.8% +11.4% ➖ noise
39 datafusion:vortex-file-compressed +5.5% -2.5% +8.1% +15.0% ➖ noise
39 duckdb:duckdb -4.0% -2.5% -1.6% +25.1% ➖ noise
39 duckdb:vortex-compact +0.3% -2.5% +2.8% +15.7% ➖ noise
39 duckdb:vortex-file-compressed -9.0% -2.5% -6.7% +20.5% ➖ noise
40 datafusion:vortex-compact +0.0% -1.2% +1.2% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -0.8% -1.2% +0.5% +10.0% ➖ noise
40 duckdb:duckdb +1.0% -1.2% +2.2% +16.2% ➖ noise
40 duckdb:vortex-compact -3.0% -1.2% -1.9% +13.5% ➖ noise
40 duckdb:vortex-file-compressed +6.0% -1.2% +7.3% +14.7% ➖ noise
41 datafusion:vortex-compact +2.2% +3.2% -1.0% +12.4% ➖ noise
41 datafusion:vortex-file-compressed +7.2% +3.2% +3.9% +17.1% ➖ noise
41 duckdb:duckdb +0.4% +3.2% -2.7% +11.4% ➖ noise
41 duckdb:vortex-compact +12.3% +3.2% +8.9% +11.9% ➖ noise
41 duckdb:vortex-file-compressed +2.7% +3.2% -0.4% +11.1% ➖ noise
42 datafusion:vortex-compact -1.0% +3.0% -3.9% +10.0% ➖ noise
42 datafusion:vortex-file-compressed -1.3% +3.0% -4.2% +11.3% ➖ noise
42 duckdb:duckdb +1.0% +3.0% -2.0% +11.3% ➖ noise
42 duckdb:vortex-compact +3.1% +3.0% +0.1% +11.7% ➖ noise
42 duckdb:vortex-file-compressed +6.5% +3.0% +3.4% +13.4% ➖ noise
43 datafusion:vortex-compact +2.0% +0.7% +1.2% +10.0% ➖ noise
43 datafusion:vortex-file-compressed +4.6% +0.7% +3.8% +10.0% ➖ noise
43 duckdb:duckdb -1.6% +0.7% -2.4% +10.0% ➖ noise
43 duckdb:vortex-compact +1.3% +0.7% +0.6% +24.8% ➖ noise
43 duckdb:vortex-file-compressed +3.1% +0.7% +2.4% +10.0% ➖ noise
44 datafusion:vortex-compact +1.0% -2.7% +3.9% +10.0% ➖ noise
44 datafusion:vortex-file-compressed -0.6% -2.7% +2.2% +10.0% ➖ noise
44 duckdb:duckdb +7.7% -2.7% +10.8% +11.5% ➖ noise
44 duckdb:vortex-compact +1.1% -2.7% +3.9% +10.0% ➖ noise
44 duckdb:vortex-file-compressed -0.8% -2.7% +2.0% +10.1% ➖ noise
45 datafusion:vortex-compact -0.4% +0.3% -0.6% +10.0% ➖ noise
45 datafusion:vortex-file-compressed +3.6% +0.3% +3.3% +11.7% ➖ noise
45 duckdb:duckdb -7.0% +0.3% -7.3% +14.9% ➖ noise
45 duckdb:vortex-compact +2.4% +0.3% +2.2% +10.0% ➖ noise
45 duckdb:vortex-file-compressed +3.2% +0.3% +3.0% +16.7% ➖ noise
46 datafusion:vortex-compact -3.0% -1.4% -1.7% +10.0% ➖ noise
46 datafusion:vortex-file-compressed +0.7% -1.4% +2.1% +10.1% ➖ noise
46 duckdb:duckdb +1.2% -1.4% +2.6% +10.0% ➖ noise
46 duckdb:vortex-compact +3.1% -1.4% +4.5% +10.0% ➖ noise
46 duckdb:vortex-file-compressed +2.9% -1.4% +4.3% +10.0% ➖ noise
47 datafusion:vortex-compact -0.7% +1.9% -2.5% +10.0% ➖ noise
47 datafusion:vortex-file-compressed +1.1% +1.9% -0.8% +10.0% ➖ noise
47 duckdb:duckdb -1.8% +1.9% -3.6% +10.0% ➖ noise
47 duckdb:vortex-compact +4.3% +1.9% +2.4% +10.0% ➖ noise
47 duckdb:vortex-file-compressed +3.0% +1.9% +1.1% +10.0% ➖ noise
48 datafusion:vortex-compact +0.9% -1.3% +2.2% +11.0% ➖ noise
48 datafusion:vortex-file-compressed +1.1% -1.3% +2.5% +10.0% ➖ noise
48 duckdb:duckdb +2.6% -1.3% +4.0% +13.0% ➖ noise
48 duckdb:vortex-compact +1.7% -1.3% +3.0% +10.0% ➖ noise
48 duckdb:vortex-file-compressed +6.4% -1.3% +7.8% +10.0% ➖ noise
49 datafusion:vortex-compact +2.3% +3.4% -1.1% +10.0% ➖ noise
49 datafusion:vortex-file-compressed +0.8% +3.4% -2.5% +10.0% ➖ noise
49 duckdb:duckdb -2.4% +3.4% -5.6% +10.8% ➖ noise
49 duckdb:vortex-compact +2.3% +3.4% -1.1% +10.0% ➖ noise
49 duckdb:vortex-file-compressed +5.9% +3.4% +2.4% +14.4% ➖ noise
50 datafusion:vortex-compact +2.0% -0.0% +2.0% +10.0% ➖ noise
50 datafusion:vortex-file-compressed +1.6% -0.0% +1.6% +10.0% ➖ noise
50 duckdb:duckdb +5.7% -0.0% +5.7% +10.6% ➖ noise
50 duckdb:vortex-compact +0.2% -0.0% +0.2% +10.0% ➖ noise
50 duckdb:vortex-file-compressed +5.0% -0.0% +5.0% +11.9% ➖ noise
51 datafusion:vortex-compact +4.6% +1.4% +3.2% +10.0% ➖ noise
51 datafusion:vortex-file-compressed +1.7% +1.4% +0.3% +10.0% ➖ noise
51 duckdb:duckdb -1.0% +1.4% -2.3% +27.7% ➖ noise
51 duckdb:vortex-compact +1.7% +1.4% +0.3% +15.5% ➖ noise
51 duckdb:vortex-file-compressed +0.4% +1.4% -1.0% +10.0% ➖ noise
52 datafusion:vortex-compact +0.1% +0.7% -0.6% +13.2% ➖ noise
52 datafusion:vortex-file-compressed -6.4% +0.7% -7.0% +11.2% ➖ noise
52 duckdb:duckdb +5.9% +0.7% +5.1% +12.1% ➖ noise
52 duckdb:vortex-compact -1.2% +0.7% -1.9% +11.3% ➖ noise
52 duckdb:vortex-file-compressed -0.9% +0.7% -1.5% +12.9% ➖ noise
53 datafusion:vortex-compact +5.0% -0.4% +5.4% +18.8% ➖ noise
53 datafusion:vortex-file-compressed -1.1% -0.4% -0.7% +18.7% ➖ noise
53 duckdb:duckdb +0.1% -0.4% +0.5% +19.0% ➖ noise
53 duckdb:vortex-compact +1.3% -0.4% +1.7% +18.8% ➖ noise
53 duckdb:vortex-file-compressed -0.1% -0.4% +0.3% +16.9% ➖ noise
54 datafusion:vortex-compact +0.5% -0.3% +0.9% +10.0% ➖ noise
54 datafusion:vortex-file-compressed +2.8% -0.3% +3.2% +10.0% ➖ noise
54 duckdb:duckdb -0.5% -0.3% -0.2% +10.7% ➖ noise
54 duckdb:vortex-compact -3.5% -0.3% -3.2% +10.0% ➖ noise
54 duckdb:vortex-file-compressed +2.4% -0.3% +2.7% +10.0% ➖ noise
55 datafusion:vortex-compact +4.0% +2.7% +1.3% +10.5% ➖ noise
55 datafusion:vortex-file-compressed +6.8% +2.7% +4.0% +10.0% ➖ noise
55 duckdb:duckdb +4.5% +2.7% +1.8% +11.8% ➖ noise
55 duckdb:vortex-compact +3.2% +2.7% +0.5% +11.2% ➖ noise
55 duckdb:vortex-file-compressed +2.5% +2.7% -0.2% +14.0% ➖ noise
56 datafusion:vortex-compact +1.0% -0.6% +1.6% +10.0% ➖ noise
56 datafusion:vortex-file-compressed +2.6% -0.6% +3.2% +13.2% ➖ noise
56 duckdb:duckdb +7.5% -0.6% +8.2% +11.6% ➖ noise
56 duckdb:vortex-compact -5.1% -0.6% -4.5% +10.0% ➖ noise
56 duckdb:vortex-file-compressed +4.8% -0.6% +5.5% +10.4% ➖ noise
57 datafusion:vortex-compact +1.6% +4.2% -2.5% +11.2% ➖ noise
57 datafusion:vortex-file-compressed +2.6% +4.2% -1.5% +11.3% ➖ noise
57 duckdb:duckdb +3.0% +4.2% -1.1% +17.9% ➖ noise
57 duckdb:vortex-compact +3.9% +4.2% -0.3% +11.3% ➖ noise
57 duckdb:vortex-file-compressed +2.0% +4.2% -2.1% +16.6% ➖ noise
58 datafusion:vortex-compact +5.0% +4.1% +0.9% +10.0% ➖ noise
58 datafusion:vortex-file-compressed +2.2% +4.1% -1.8% +10.0% ➖ noise
58 duckdb:duckdb +2.0% +4.1% -2.0% +10.0% ➖ noise
58 duckdb:vortex-compact -1.0% +4.1% -4.9% +21.1% ➖ noise
58 duckdb:vortex-file-compressed -2.4% +4.1% -6.2% +15.0% ➖ noise
59 datafusion:vortex-compact -1.0% +1.1% -2.1% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -2.4% +1.1% -3.5% +10.0% ➖ noise
59 duckdb:duckdb -0.7% +1.1% -1.8% +10.0% ➖ noise
59 duckdb:vortex-compact +3.1% +1.1% +2.0% +10.9% ➖ noise
59 duckdb:vortex-file-compressed +0.5% +1.1% -0.5% +10.0% ➖ noise
60 datafusion:vortex-compact +1.3% +1.4% -0.1% +10.0% ➖ noise
60 datafusion:vortex-file-compressed +0.2% +1.4% -1.2% +10.0% ➖ noise
60 duckdb:duckdb +6.1% +1.4% +4.6% +12.7% ➖ noise
60 duckdb:vortex-compact -0.3% +1.4% -1.6% +11.1% ➖ noise
60 duckdb:vortex-file-compressed -0.7% +1.4% -2.1% +12.2% ➖ noise
61 datafusion:vortex-compact +1.0% -1.1% +2.0% +10.0% ➖ noise
61 datafusion:vortex-file-compressed +1.1% -1.1% +2.2% +10.0% ➖ noise
61 duckdb:duckdb +0.3% -1.1% +1.3% +10.0% ➖ noise
61 duckdb:vortex-compact -1.0% -1.1% +0.1% +10.0% ➖ noise
61 duckdb:vortex-file-compressed +1.8% -1.1% +2.9% +10.0% ➖ noise
62 datafusion:vortex-compact +6.1% +7.5% -1.3% +11.0% ➖ noise
62 datafusion:vortex-file-compressed -0.9% +7.5% -7.8% +11.0% ➖ noise
62 duckdb:duckdb +1.7% +7.5% -5.4% +10.4% ➖ noise
62 duckdb:vortex-compact +2.2% +7.5% -4.9% +13.1% ➖ noise
62 duckdb:vortex-file-compressed +19.2% +7.5% +10.9% +22.0% ➖ noise
63 datafusion:vortex-compact +0.2% +2.8% -2.5% +10.0% ➖ noise
63 datafusion:vortex-file-compressed -0.7% +2.8% -3.4% +10.0% ➖ noise
63 duckdb:duckdb -0.3% +2.8% -3.0% +10.0% ➖ noise
63 duckdb:vortex-compact +0.9% +2.8% -1.8% +10.3% ➖ noise
63 duckdb:vortex-file-compressed +4.0% +2.8% +1.3% +10.0% ➖ noise
64 datafusion:vortex-compact +1.1% +0.1% +1.0% +10.0% ➖ noise
64 datafusion:vortex-file-compressed +0.4% +0.1% +0.2% +10.0% ➖ noise
64 duckdb:duckdb -0.1% +0.1% -0.2% +10.0% ➖ noise
64 duckdb:vortex-compact -2.2% +0.1% -2.4% +10.0% ➖ noise
64 duckdb:vortex-file-compressed +0.5% +0.1% +0.3% +10.0% ➖ noise
65 datafusion:vortex-compact -1.8% -5.4% +3.8% +10.0% ➖ noise
65 datafusion:vortex-file-compressed +0.7% -5.4% +6.5% +11.2% ➖ noise
65 duckdb:duckdb +7.4% -5.4% +13.6% +14.3% ➖ noise
65 duckdb:vortex-compact +1.5% -5.4% +7.3% +10.0% ➖ noise
65 duckdb:vortex-file-compressed +2.4% -5.4% +8.3% +10.8% ➖ noise
66 datafusion:vortex-compact -1.5% +2.6% -4.0% +10.0% ➖ noise
66 datafusion:vortex-file-compressed -2.2% +2.6% -4.6% +10.0% ➖ noise
66 duckdb:duckdb +4.4% +2.6% +1.8% +12.7% ➖ noise
66 duckdb:vortex-compact +6.3% +2.6% +3.6% +14.9% ➖ noise
66 duckdb:vortex-file-compressed +3.2% +2.6% +0.6% +10.0% ➖ noise
67 datafusion:vortex-compact +2.7% +3.1% -0.4% +10.0% ➖ noise
67 datafusion:vortex-file-compressed -2.1% +3.1% -5.0% +11.2% ➖ noise
67 duckdb:duckdb +0.5% +3.1% -2.6% +10.0% ➖ noise
67 duckdb:vortex-compact +2.6% +3.1% -0.5% +10.0% ➖ noise
67 duckdb:vortex-file-compressed +2.5% +3.1% -0.6% +10.0% ➖ noise
68 datafusion:vortex-compact -0.8% +1.8% -2.5% +10.0% ➖ noise
68 datafusion:vortex-file-compressed -1.2% +1.8% -3.0% +10.0% ➖ noise
68 duckdb:duckdb -0.7% +1.8% -2.4% +10.0% ➖ noise
68 duckdb:vortex-compact +3.3% +1.8% +1.5% +12.9% ➖ noise
68 duckdb:vortex-file-compressed -0.1% +1.8% -1.9% +10.0% ➖ noise
69 datafusion:vortex-compact +1.8% +2.1% -0.3% +10.0% ➖ noise
69 datafusion:vortex-file-compressed +2.1% +2.1% -0.0% +10.0% ➖ noise
69 duckdb:duckdb +0.3% +2.1% -1.7% +10.0% ➖ noise
69 duckdb:vortex-compact +1.0% +2.1% -1.0% +10.0% ➖ noise
69 duckdb:vortex-file-compressed +2.9% +2.1% +0.8% +10.0% ➖ noise
70 datafusion:vortex-compact +3.1% +0.2% +2.9% +10.0% ➖ noise
70 datafusion:vortex-file-compressed +2.3% +0.2% +2.1% +10.2% ➖ noise
70 duckdb:duckdb +2.0% +0.2% +1.8% +14.5% ➖ noise
70 duckdb:vortex-compact +3.2% +0.2% +3.0% +10.0% ➖ noise
70 duckdb:vortex-file-compressed +6.1% +0.2% +5.9% +12.9% ➖ noise
71 datafusion:vortex-compact -0.8% +0.3% -1.1% +10.0% ➖ noise
71 datafusion:vortex-file-compressed +2.5% +0.3% +2.2% +13.5% ➖ noise
71 duckdb:duckdb +1.3% +0.3% +1.0% +15.3% ➖ noise
71 duckdb:vortex-compact +2.8% +0.3% +2.5% +13.4% ➖ noise
71 duckdb:vortex-file-compressed +8.9% +0.3% +8.6% +16.9% ➖ noise
72 datafusion:vortex-compact +2.2% +0.5% +1.7% +10.0% ➖ noise
72 datafusion:vortex-file-compressed +1.7% +0.5% +1.3% +10.0% ➖ noise
72 duckdb:duckdb +1.3% +0.5% +0.8% +12.5% ➖ noise
72 duckdb:vortex-compact +1.3% +0.5% +0.8% +10.0% ➖ noise
72 duckdb:vortex-file-compressed +0.9% +0.5% +0.5% +10.0% ➖ noise
73 datafusion:vortex-compact +2.3% -1.3% +3.7% +15.5% ➖ noise
73 datafusion:vortex-file-compressed +1.5% -1.3% +2.9% +22.8% ➖ noise
73 duckdb:duckdb +6.9% -1.3% +8.4% +10.2% ➖ noise
73 duckdb:vortex-compact -0.0% -1.3% +1.3% +10.0% ➖ noise
73 duckdb:vortex-file-compressed +5.4% -1.3% +6.9% +11.7% ➖ noise
74 datafusion:vortex-compact -0.1% +1.5% -1.6% +10.0% ➖ noise
74 datafusion:vortex-file-compressed +2.1% +1.5% +0.6% +10.0% ➖ noise
74 duckdb:duckdb +2.0% +1.5% +0.4% +10.0% ➖ noise
74 duckdb:vortex-compact +2.1% +1.5% +0.6% +10.0% ➖ noise
74 duckdb:vortex-file-compressed +1.1% +1.5% -0.4% +24.1% ➖ noise
75 datafusion:vortex-compact -0.0% +1.3% -1.3% +10.0% ➖ noise
75 datafusion:vortex-file-compressed +3.6% +1.3% +2.3% +10.0% ➖ noise
75 duckdb:duckdb +0.9% +1.3% -0.3% +10.0% ➖ noise
75 duckdb:vortex-compact +2.6% +1.3% +1.3% +10.2% ➖ noise
75 duckdb:vortex-file-compressed -0.3% +1.3% -1.6% +10.0% ➖ noise
76 datafusion:vortex-compact -1.8% +3.7% -5.3% +10.0% ➖ noise
76 datafusion:vortex-file-compressed +1.9% +3.7% -1.7% +10.2% ➖ noise
76 duckdb:duckdb +7.8% +3.7% +4.0% +15.3% ➖ noise
76 duckdb:vortex-compact +4.5% +3.7% +0.8% +10.0% ➖ noise
76 duckdb:vortex-file-compressed -1.6% +3.7% -5.1% +13.6% ➖ noise
77 datafusion:vortex-compact -0.3% -2.6% +2.4% +12.2% ➖ noise
77 datafusion:vortex-file-compressed +3.3% -2.6% +6.1% +12.5% ➖ noise
77 duckdb:duckdb +7.1% -2.6% +10.0% +17.6% ➖ noise
77 duckdb:vortex-compact -2.0% -2.6% +0.6% +10.4% ➖ noise
77 duckdb:vortex-file-compressed -0.8% -2.6% +1.9% +14.1% ➖ noise
78 datafusion:vortex-compact -0.5% -0.8% +0.2% +10.0% ➖ noise
78 datafusion:vortex-file-compressed +0.6% -0.8% +1.4% +10.0% ➖ noise
78 duckdb:duckdb +1.7% -0.8% +2.4% +15.4% ➖ noise
78 duckdb:vortex-compact +2.0% -0.8% +2.8% +10.0% ➖ noise
78 duckdb:vortex-file-compressed -1.7% -0.8% -1.0% +10.0% ➖ noise
79 datafusion:vortex-compact -2.4% +1.0% -3.3% +10.9% ➖ noise
79 datafusion:vortex-file-compressed +2.0% +1.0% +1.0% +10.0% ➖ noise
79 duckdb:duckdb +1.9% +1.0% +0.9% +10.3% ➖ noise
79 duckdb:vortex-compact +2.1% +1.0% +1.1% +10.6% ➖ noise
79 duckdb:vortex-file-compressed +1.1% +1.0% +0.1% +17.0% ➖ noise
80 datafusion:vortex-compact +3.1% +3.0% +0.0% +10.0% ➖ noise
80 datafusion:vortex-file-compressed +1.5% +3.0% -1.5% +10.0% ➖ noise
80 duckdb:duckdb +1.4% +3.0% -1.5% +12.6% ➖ noise
80 duckdb:vortex-compact -2.5% +3.0% -5.4% +10.0% ➖ noise
80 duckdb:vortex-file-compressed +4.1% +3.0% +1.0% +10.0% ➖ noise
81 datafusion:vortex-compact -6.4% +3.8% -9.9% +12.1% ➖ noise
81 datafusion:vortex-file-compressed -1.8% +3.8% -5.4% +12.4% ➖ noise
81 duckdb:duckdb -1.4% +3.8% -5.0% +12.3% ➖ noise
81 duckdb:vortex-compact +1.3% +3.8% -2.4% +11.9% ➖ noise
81 duckdb:vortex-file-compressed +1.7% +3.8% -2.0% +15.1% ➖ noise
82 datafusion:vortex-compact -1.3% +3.0% -4.2% +10.0% ➖ noise
82 datafusion:vortex-file-compressed +2.1% +3.0% -0.9% +10.8% ➖ noise
82 duckdb:duckdb +3.9% +3.0% +0.9% +13.0% ➖ noise
82 duckdb:vortex-compact -6.1% +3.0% -8.8% +11.8% ➖ noise
82 duckdb:vortex-file-compressed -0.2% +3.0% -3.1% +18.0% ➖ noise
83 datafusion:vortex-compact +1.4% -1.0% +2.5% +10.0% ➖ noise
83 datafusion:vortex-file-compressed +0.7% -1.0% +1.8% +10.0% ➖ noise
83 duckdb:duckdb +1.2% -1.0% +2.2% +10.8% ➖ noise
83 duckdb:vortex-compact +7.1% -1.0% +8.3% +11.0% ➖ noise
83 duckdb:vortex-file-compressed +2.0% -1.0% +3.1% +13.6% ➖ noise
84 datafusion:vortex-compact +3.6% +2.5% +1.1% +14.0% ➖ noise
84 datafusion:vortex-file-compressed +3.9% +2.5% +1.4% +10.0% ➖ noise
84 duckdb:duckdb -1.5% +2.5% -3.9% +11.5% ➖ noise
84 duckdb:vortex-compact +1.2% +2.5% -1.2% +10.0% ➖ noise
84 duckdb:vortex-file-compressed +4.7% +2.5% +2.2% +10.0% ➖ noise
85 datafusion:vortex-compact -1.4% +2.4% -3.7% +10.0% ➖ noise
85 datafusion:vortex-file-compressed +0.7% +2.4% -1.7% +10.0% ➖ noise
85 duckdb:duckdb +2.7% +2.4% +0.3% +15.8% ➖ noise
85 duckdb:vortex-compact -0.1% +2.4% -2.5% +10.0% ➖ noise
85 duckdb:vortex-file-compressed +2.2% +2.4% -0.2% +10.0% ➖ noise
86 datafusion:vortex-compact +0.2% +2.0% -1.7% +11.2% ➖ noise
86 datafusion:vortex-file-compressed +6.7% +2.0% +4.6% +11.3% ➖ noise
86 duckdb:duckdb +0.3% +2.0% -1.6% +12.6% ➖ noise
86 duckdb:vortex-compact -10.0% +2.0% -11.8% +20.7% ➖ noise
86 duckdb:vortex-file-compressed +3.3% +2.0% +1.3% +18.5% ➖ noise
87 datafusion:vortex-compact -1.1% -2.7% +1.6% +10.0% ➖ noise
87 datafusion:vortex-file-compressed +4.8% -2.7% +7.7% +10.0% ➖ noise
87 duckdb:duckdb +7.3% -2.7% +10.3% +10.0% 🚨 regression
87 duckdb:vortex-compact +4.8% -2.7% +7.7% +11.2% ➖ noise
87 duckdb:vortex-file-compressed +6.4% -2.7% +9.3% +13.4% ➖ noise
88 datafusion:vortex-compact +2.5% +0.7% +1.7% +10.0% ➖ noise
88 datafusion:vortex-file-compressed +1.1% +0.7% +0.4% +10.0% ➖ noise
88 duckdb:duckdb +1.9% +0.7% +1.2% +10.0% ➖ noise
88 duckdb:vortex-compact +3.4% +0.7% +2.7% +10.0% ➖ noise
88 duckdb:vortex-file-compressed +3.9% +0.7% +3.2% +10.0% ➖ noise
89 datafusion:vortex-compact -2.0% -0.5% -1.6% +10.9% ➖ noise
89 datafusion:vortex-file-compressed +1.3% -0.5% +1.7% +11.0% ➖ noise
89 duckdb:duckdb +1.4% -0.5% +1.9% +12.1% ➖ noise
89 duckdb:vortex-compact +2.9% -0.5% +3.4% +10.8% ➖ noise
89 duckdb:vortex-file-compressed +3.7% -0.5% +4.2% +10.7% ➖ noise
90 datafusion:vortex-compact -1.5% +4.6% -5.8% +10.0% ➖ noise
90 datafusion:vortex-file-compressed +0.1% +4.6% -4.2% +10.0% ➖ noise
90 duckdb:duckdb +2.6% +4.6% -1.9% +10.0% ➖ noise
90 duckdb:vortex-compact +4.3% +4.6% -0.3% +10.9% ➖ noise
90 duckdb:vortex-file-compressed +4.7% +4.6% +0.1% +11.0% ➖ noise
91 datafusion:vortex-compact -1.0% +2.0% -2.9% +10.0% ➖ noise
91 datafusion:vortex-file-compressed -1.5% +2.0% -3.4% +10.0% ➖ noise
91 duckdb:duckdb -5.0% +2.0% -6.8% +16.2% ➖ noise
91 duckdb:vortex-compact -1.6% +2.0% -3.5% +10.0% ➖ noise
91 duckdb:vortex-file-compressed +5.6% +2.0% +3.6% +10.5% ➖ noise
92 datafusion:vortex-compact -4.9% +2.9% -7.6% +10.0% ➖ noise
92 datafusion:vortex-file-compressed +5.8% +2.9% +2.8% +10.0% ➖ noise
92 duckdb:duckdb +5.9% +2.9% +2.9% +11.9% ➖ noise
92 duckdb:vortex-compact +3.2% +2.9% +0.2% +17.0% ➖ noise
92 duckdb:vortex-file-compressed +5.7% +2.9% +2.7% +14.2% ➖ noise
93 datafusion:vortex-compact -1.3% +4.3% -5.3% +10.0% ➖ noise
93 datafusion:vortex-file-compressed +0.3% +4.3% -3.8% +10.0% ➖ noise
93 duckdb:duckdb +1.9% +4.3% -2.2% +12.6% ➖ noise
93 duckdb:vortex-compact +4.2% +4.3% -0.1% +16.2% ➖ noise
93 duckdb:vortex-file-compressed +12.4% +4.3% +7.8% +13.5% ➖ noise
94 datafusion:vortex-compact +0.8% +7.6% -6.4% +10.0% ➖ noise
94 datafusion:vortex-file-compressed -2.1% +7.6% -9.0% +14.2% ➖ noise
94 duckdb:duckdb -2.0% +7.6% -8.9% +11.1% ➖ noise
94 duckdb:vortex-compact +2.2% +7.6% -5.1% +12.7% ➖ noise
94 duckdb:vortex-file-compressed -5.9% +7.6% -12.6% +10.0% ✅ faster
95 datafusion:vortex-compact +2.2% +6.7% -4.3% +12.6% ➖ noise
95 datafusion:vortex-file-compressed +1.7% +6.7% -4.7% +12.6% ➖ noise
95 duckdb:duckdb -14.0% +6.7% -19.4% +21.6% ✅ faster
95 duckdb:vortex-compact +7.8% +6.7% +1.0% +16.4% ➖ noise
95 duckdb:vortex-file-compressed +12.2% +6.7% +5.1% +22.8% ➖ noise
96 datafusion:vortex-compact -0.3% +2.8% -3.0% +11.4% ➖ noise
96 datafusion:vortex-file-compressed -1.2% +2.8% -3.9% +14.2% ➖ noise
96 duckdb:duckdb +2.6% +2.8% -0.2% +15.3% ➖ noise
96 duckdb:vortex-compact +0.7% +2.8% -2.1% +11.5% ➖ noise
96 duckdb:vortex-file-compressed -0.0% +2.8% -2.8% +15.2% ➖ noise
97 datafusion:vortex-compact +0.1% -0.9% +1.0% +10.0% ➖ noise
97 datafusion:vortex-file-compressed +2.6% -0.9% +3.6% +12.0% ➖ noise
97 duckdb:duckdb -1.4% -0.9% -0.5% +16.2% ➖ noise
97 duckdb:vortex-compact +7.4% -0.9% +8.4% +17.4% ➖ noise
97 duckdb:vortex-file-compressed +3.5% -0.9% +4.5% +11.8% ➖ noise
98 datafusion:vortex-compact +1.7% +1.4% +0.3% +10.0% ➖ noise
98 datafusion:vortex-file-compressed +3.0% +1.4% +1.6% +10.0% ➖ noise
98 duckdb:duckdb -0.2% +1.4% -1.6% +14.4% ➖ noise
98 duckdb:vortex-compact +1.4% +1.4% -0.0% +10.0% ➖ noise
98 duckdb:vortex-file-compressed +3.3% +1.4% +1.9% +13.5% ➖ noise
99 datafusion:vortex-compact -0.0% +4.2% -4.0% +16.7% ➖ noise
99 datafusion:vortex-file-compressed +3.7% +4.2% -0.5% +16.1% ➖ noise
99 duckdb:duckdb -0.3% +4.2% -4.3% +14.9% ➖ noise
99 duckdb:vortex-compact +2.4% +4.2% -1.7% +37.4% ➖ noise
99 duckdb:vortex-file-compressed +5.9% +4.2% +1.7% +20.1% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 16, 2026

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 16, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.4%
Vortex (geomean): 0.993x ➖
Parquet (geomean): 0.961x ➖
Shifts: Parquet (control) -3.9% · Median polish -2.3%

datafusion / vortex-file-compressed (1.039x ➖, 0↑ 1↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 36735908 40952795 0.90
fineweb_q01/datafusion:vortex-file-compressed 490777967 514769623 0.95
fineweb_q02/datafusion:vortex-file-compressed 🚨 568207134 427676185 1.33
fineweb_q03/datafusion:vortex-file-compressed 1434706928 1337710900 1.07
fineweb_q04/datafusion:vortex-file-compressed 1406067749 1376071347 1.02
fineweb_q05/datafusion:vortex-file-compressed 1376238430 1337656537 1.03
fineweb_q06/datafusion:vortex-file-compressed 1494284851 1417414399 1.05
fineweb_q07/datafusion:vortex-file-compressed 1321578214 1325069503 1.00
fineweb_q08/datafusion:vortex-file-compressed 538945239 515504743 1.05
datafusion / vortex-compact (0.998x ➖, 0↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 35924151 33256953 1.08
fineweb_q01/datafusion:vortex-compact 579562365 581664766 1.00
fineweb_q02/datafusion:vortex-compact 597315629 580527845 1.03
fineweb_q03/datafusion:vortex-compact 1830228640 1826566234 1.00
fineweb_q04/datafusion:vortex-compact 2225490583 2268034794 0.98
fineweb_q05/datafusion:vortex-compact 1691441476 1679664952 1.01
fineweb_q06/datafusion:vortex-compact 1483866602 1657742910 0.90
fineweb_q07/datafusion:vortex-compact 1368789303 1335229264 1.03
fineweb_q08/datafusion:vortex-compact 413545894 422207080 0.98
datafusion / parquet (0.952x ➖, 0↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1112892836 1130229780 0.98
fineweb_q01/datafusion:parquet 1717038130 1784680709 0.96
fineweb_q02/datafusion:parquet 1866601323 1856745960 1.01
fineweb_q03/datafusion:parquet 1775908840 2023475941 0.88
fineweb_q04/datafusion:parquet 1744095749 1973401602 0.88
fineweb_q05/datafusion:parquet 1730212049 1927005728 0.90
fineweb_q06/datafusion:parquet 1746574445 1818699905 0.96
fineweb_q07/datafusion:parquet 1837610843 1761860605 1.04
fineweb_q08/datafusion:parquet 1779219357 1842745460 0.97
duckdb / vortex-file-compressed (0.958x ➖, 0↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 83525629 87775867 0.95
fineweb_q01/duckdb:vortex-file-compressed 540186681 560565739 0.96
fineweb_q02/duckdb:vortex-file-compressed 454887499 561582499 0.81
fineweb_q03/duckdb:vortex-file-compressed 1520544822 1490817248 1.02
fineweb_q04/duckdb:vortex-file-compressed 1513165089 1649242637 0.92
fineweb_q05/duckdb:vortex-file-compressed 1450269340 1577990111 0.92
fineweb_q06/duckdb:vortex-file-compressed 1683087502 1651691785 1.02
fineweb_q07/duckdb:vortex-file-compressed 1481917256 1486438804 1.00
fineweb_q08/duckdb:vortex-file-compressed 629327072 603567017 1.04
duckdb / vortex-compact (0.980x ➖, 0↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 74177957 88226052 0.84
fineweb_q01/duckdb:vortex-compact 548127579 568139853 0.96
fineweb_q02/duckdb:vortex-compact 551483926 633948763 0.87
fineweb_q03/duckdb:vortex-compact 1660433912 1623546947 1.02
fineweb_q04/duckdb:vortex-compact 1754583634 1683191631 1.04
fineweb_q05/duckdb:vortex-compact 1390077950 1550825711 0.90
fineweb_q06/duckdb:vortex-compact 1443203701 1474770621 0.98
fineweb_q07/duckdb:vortex-compact 1409272517 1309772783 1.08
fineweb_q08/duckdb:vortex-compact 551584414 468926467 1.18
duckdb / parquet (0.970x ➖, 0↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1095892572 1104859412 0.99
fineweb_q01/duckdb:parquet 1327521424 1406931395 0.94
fineweb_q02/duckdb:parquet 1312741660 1332673437 0.99
fineweb_q03/duckdb:parquet 3485916900 3575620424 0.97
fineweb_q04/duckdb:parquet 1881722507 1927195985 0.98
fineweb_q05/duckdb:parquet 1974862145 2018646836 0.98
fineweb_q06/duckdb:parquet 4301300412 4229002244 1.02
fineweb_q07/duckdb:parquet 2586861434 2842117371 0.91
fineweb_q08/duckdb:parquet 1070940388 1121728893 0.95
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +8.0% -1.2% +9.3% +193.8% ➖ noise
0 datafusion:vortex-file-compressed -10.3% -1.2% -9.2% +142.3% ➖ noise
0 duckdb:vortex-compact -15.9% -1.2% -14.9% +66.9% ➖ noise
0 duckdb:vortex-file-compressed -4.8% -1.2% -3.7% +34.1% ➖ noise
1 datafusion:vortex-compact -0.4% -4.7% +4.6% +62.6% ➖ noise
1 datafusion:vortex-file-compressed -4.7% -4.7% +0.1% +86.8% ➖ noise
1 duckdb:vortex-compact -3.5% -4.7% +1.3% +59.2% ➖ noise
1 duckdb:vortex-file-compressed -3.6% -4.7% +1.1% +30.0% ➖ noise
2 datafusion:vortex-compact +2.9% -0.5% +3.4% +30.0% ➖ noise
2 datafusion:vortex-file-compressed +32.9% -0.5% +33.5% +35.1% ➖ noise
2 duckdb:vortex-compact -13.0% -0.5% -12.6% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -19.0% -0.5% -18.6% +30.0% ➖ noise
3 datafusion:vortex-compact +0.2% -7.5% +8.3% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +7.3% -7.5% +15.9% +30.0% ➖ noise
3 duckdb:vortex-compact +2.3% -7.5% +10.6% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +2.0% -7.5% +10.3% +30.0% ➖ noise
4 datafusion:vortex-compact -1.9% -7.1% +5.6% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +2.2% -7.1% +10.0% +30.0% ➖ noise
4 duckdb:vortex-compact +4.2% -7.1% +12.2% +44.9% ➖ noise
4 duckdb:vortex-file-compressed -8.3% -7.1% -1.2% +30.0% ➖ noise
5 datafusion:vortex-compact +0.7% -6.3% +7.4% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +2.9% -6.3% +9.8% +30.0% ➖ noise
5 duckdb:vortex-compact -10.4% -6.3% -4.4% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -8.1% -6.3% -1.9% +30.0% ➖ noise
6 datafusion:vortex-compact -10.5% -1.2% -9.4% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +5.4% -1.2% +6.7% +30.0% ➖ noise
6 duckdb:vortex-compact -2.1% -1.2% -1.0% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +1.9% -1.2% +3.1% +30.0% ➖ noise
7 datafusion:vortex-compact +2.5% -2.6% +5.2% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -0.3% -2.6% +2.4% +30.0% ➖ noise
7 duckdb:vortex-compact +7.6% -2.6% +10.4% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -0.3% -2.6% +2.3% +30.0% ➖ noise
8 datafusion:vortex-compact -2.1% -4.0% +2.0% +36.1% ➖ noise
8 datafusion:vortex-file-compressed +4.5% -4.0% +8.9% +30.0% ➖ noise
8 duckdb:vortex-compact +17.6% -4.0% +22.5% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +4.3% -4.0% +8.6% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 16, 2026

Benchmarks: Random Access

Vortex (geomean): 0.864x ✅
Parquet (geomean): 1.026x ➖

unknown / unknown (0.956x ➖, 6↑ 4↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 2552395 2547458 1.00
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1260556 1265575 1.00
random-access/feature-vectors/correlated/parquet-tokio-local-disk 11420757240 11937733900 0.96
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 11081120420 11458106320 0.97
random-access/feature-vectors/correlated/vortex-tokio-local-disk 9315425 9716651 0.96
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 7575394 7896579 0.96
random-access/feature-vectors/uniform/lance-tokio-local-disk 1527964 1545348 0.99
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 2399768 2428912 0.99
random-access/feature-vectors/uniform/parquet-tokio-local-disk 11110159340 11342102946 0.98
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 11095749664 11305278955 0.98
random-access/feature-vectors/uniform/vortex-tokio-local-disk 13889376 15179488 0.92
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 14030075 15131176 0.93
random-access/lance-tokio-local-disk 739066 754740 0.98
random-access/lance-tokio-local-disk-footer 1336955 1374331 0.97
random-access/nested-lists/correlated/lance-tokio-local-disk 273471 273049 1.00
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 706403 694805 1.02
random-access/nested-lists/correlated/parquet-tokio-local-disk 138900297 140846005 0.99
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 140013480 139156495 1.01
random-access/nested-lists/correlated/vortex-tokio-local-disk 720151 744765 0.97
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 730770 750493 0.97
random-access/nested-lists/uniform/lance-tokio-local-disk 1241589 1255284 0.99
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1725135 1723424 1.00
random-access/nested-lists/uniform/parquet-tokio-local-disk 139425577 135408433 1.03
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 138360900 135409370 1.02
random-access/nested-lists/uniform/vortex-tokio-local-disk 2411494 2536493 0.95
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2608584 2739082 0.95
random-access/nested-structs/correlated/lance-tokio-local-disk 442326 441751 1.00
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 652172 653193 1.00
random-access/nested-structs/correlated/parquet-tokio-local-disk 🚨 30124980 25034193 1.20
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 🚨 29996777 25114235 1.19
random-access/nested-structs/correlated/vortex-tokio-local-disk 951630 953075 1.00
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 935569 934059 1.00
random-access/nested-structs/uniform/lance-tokio-local-disk 3027090 3197247 0.95
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 3267024 3452275 0.95
random-access/nested-structs/uniform/parquet-tokio-local-disk 🚨 29944770 25149833 1.19
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 🚨 29992097 25117057 1.19
random-access/nested-structs/uniform/vortex-tokio-local-disk 1859677 1935931 0.96
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1877241 1926373 0.97
random-access/parquet-tokio-local-disk 180031109 189142307 0.95
random-access/parquet-tokio-local-disk-footer 181762136 186299629 0.98
random-access/taxi/correlated/lance-tokio-local-disk 968426 982382 0.99
random-access/taxi/correlated/lance-tokio-local-disk-footer 1648666 1654924 1.00
random-access/taxi/correlated/parquet-tokio-local-disk 268831788 278689235 0.96
random-access/taxi/correlated/parquet-tokio-local-disk-footer 271772030 277088145 0.98
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1771719 2914001 0.61
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1960024 2970496 0.66
random-access/taxi/uniform/lance-tokio-local-disk 9021654 9341444 0.97
random-access/taxi/uniform/lance-tokio-local-disk-footer 9699286 10036427 0.97
random-access/taxi/uniform/parquet-tokio-local-disk 285047243 293622519 0.97
random-access/taxi/uniform/parquet-tokio-local-disk-footer 286850163 291965426 0.98
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 4771576 5868786 0.81
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4704598 5837003 0.81
random-access/vortex-tokio-local-disk 🚀 1317547 2020079 0.65
random-access/vortex-tokio-local-disk-footer 🚀 1330034 1963154 0.68

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 16, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.8%
Vortex (geomean): 0.887x ✅
Parquet (geomean): 0.939x ➖
Shifts: Parquet (control) -6.1% · Median polish -3.7%

datafusion / vortex-file-compressed (0.989x ➖, 0↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 401191650 398752542 1.01
tpch_q02/datafusion:vortex-file-compressed 112536910 113256763 0.99
tpch_q03/datafusion:vortex-file-compressed 209110787 213056527 0.98
tpch_q04/datafusion:vortex-file-compressed 108118787 108178521 1.00
tpch_q05/datafusion:vortex-file-compressed 383716839 387684139 0.99
tpch_q06/datafusion:vortex-file-compressed 42046068 42578661 0.99
tpch_q07/datafusion:vortex-file-compressed 560392034 563289667 0.99
tpch_q08/datafusion:vortex-file-compressed 377308728 378846474 1.00
tpch_q09/datafusion:vortex-file-compressed 658878609 667878540 0.99
tpch_q10/datafusion:vortex-file-compressed 248293081 246607200 1.01
tpch_q11/datafusion:vortex-file-compressed 84634879 85693582 0.99
tpch_q12/datafusion:vortex-file-compressed 115754821 119115340 0.97
tpch_q13/datafusion:vortex-file-compressed 220635400 221552142 1.00
tpch_q14/datafusion:vortex-file-compressed 57060267 58076240 0.98
tpch_q15/datafusion:vortex-file-compressed 105767901 109782342 0.96
tpch_q16/datafusion:vortex-file-compressed 77386084 76384352 1.01
tpch_q17/datafusion:vortex-file-compressed 644651621 649835376 0.99
tpch_q18/datafusion:vortex-file-compressed 873793179 877533524 1.00
tpch_q19/datafusion:vortex-file-compressed 93373270 93024221 1.00
tpch_q20/datafusion:vortex-file-compressed 169086335 170454541 0.99
tpch_q21/datafusion:vortex-file-compressed 679910755 711187417 0.96
tpch_q22/datafusion:vortex-file-compressed 59494492 61034021 0.97
datafusion / vortex-compact (0.954x ➖, 3↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 436427515 442756458 0.99
tpch_q02/datafusion:vortex-compact 117456996 122510585 0.96
tpch_q03/datafusion:vortex-compact 214158849 217673117 0.98
tpch_q04/datafusion:vortex-compact 117684577 118428283 0.99
tpch_q05/datafusion:vortex-compact 388551412 397244238 0.98
tpch_q06/datafusion:vortex-compact 62677461 63094535 0.99
tpch_q07/datafusion:vortex-compact 580175330 592063353 0.98
tpch_q08/datafusion:vortex-compact 380940946 394995476 0.96
tpch_q09/datafusion:vortex-compact 670802407 688324810 0.97
tpch_q10/datafusion:vortex-compact 271967123 279437357 0.97
tpch_q11/datafusion:vortex-compact 88734217 92428613 0.96
tpch_q12/datafusion:vortex-compact 164644544 167728047 0.98
tpch_q13/datafusion:vortex-compact 272144048 275798730 0.99
tpch_q14/datafusion:vortex-compact 73473717 74579845 0.99
tpch_q15/datafusion:vortex-compact 163605387 164374917 1.00
tpch_q16/datafusion:vortex-compact 82276030 82243442 1.00
tpch_q17/datafusion:vortex-compact 643435801 648098058 0.99
tpch_q18/datafusion:vortex-compact 871030973 883325680 0.99
tpch_q19/datafusion:vortex-compact 135760740 144588926 0.94
tpch_q20/datafusion:vortex-compact 🚀 196167550 240922615 0.81
tpch_q21/datafusion:vortex-compact 🚀 697460179 887000720 0.79
tpch_q22/datafusion:vortex-compact 🚀 70928644 87120957 0.81
datafusion / parquet (1.003x ➖, 0↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 440671280 410941994 1.07
tpch_q02/datafusion:parquet 183557384 183338341 1.00
tpch_q03/datafusion:parquet 295171686 295095082 1.00
tpch_q04/datafusion:parquet 135782621 136441275 1.00
tpch_q05/datafusion:parquet 450782466 452031080 1.00
tpch_q06/datafusion:parquet 124781458 117063800 1.07
tpch_q07/datafusion:parquet 623697190 626984134 0.99
tpch_q08/datafusion:parquet 493438141 494557788 1.00
tpch_q09/datafusion:parquet 774489757 774728606 1.00
tpch_q10/datafusion:parquet 501692537 510073297 0.98
tpch_q11/datafusion:parquet 128968467 129876795 0.99
tpch_q12/datafusion:parquet 213652350 203279382 1.05
tpch_q13/datafusion:parquet 340282779 337108870 1.01
tpch_q14/datafusion:parquet 159246347 158708420 1.00
tpch_q15/datafusion:parquet 244028259 245640674 0.99
tpch_q16/datafusion:parquet 134705146 137895131 0.98
tpch_q17/datafusion:parquet 686748261 694128129 0.99
tpch_q18/datafusion:parquet 872000886 880764658 0.99
tpch_q19/datafusion:parquet 266398532 273167675 0.98
tpch_q20/datafusion:parquet 303899813 306785715 0.99
tpch_q21/datafusion:parquet 736554020 735465674 1.00
tpch_q22/datafusion:parquet 212946438 214620372 0.99
datafusion / arrow (0.991x ➖, 0↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 585973731 583936202 1.00
tpch_q02/datafusion:arrow 164094253 162449902 1.01
tpch_q03/datafusion:arrow 439276950 448733706 0.98
tpch_q04/datafusion:arrow 329526142 336698312 0.98
tpch_q05/datafusion:arrow 878350578 882188427 1.00
tpch_q06/datafusion:arrow 257411422 260835536 0.99
tpch_q07/datafusion:arrow 1080683124 1089847221 0.99
tpch_q08/datafusion:arrow 1075331988 1086406493 0.99
tpch_q09/datafusion:arrow 1279095971 1292381768 0.99
tpch_q10/datafusion:arrow 569051368 571895004 1.00
tpch_q11/datafusion:arrow 144204315 145514467 0.99
tpch_q12/datafusion:arrow 639369098 647852730 0.99
tpch_q13/datafusion:arrow 508056599 514540716 0.99
tpch_q14/datafusion:arrow 288688064 288861927 1.00
tpch_q15/datafusion:arrow 615745873 617940742 1.00
tpch_q16/datafusion:arrow 103841791 105682971 0.98
tpch_q17/datafusion:arrow 1270979459 1282642975 0.99
tpch_q18/datafusion:arrow 1752691721 1790029924 0.98
tpch_q19/datafusion:arrow 475110054 485647195 0.98
tpch_q20/datafusion:arrow 464001355 466781670 0.99
tpch_q21/datafusion:arrow 2754837974 2766295639 1.00
tpch_q22/datafusion:arrow 139203658 138946193 1.00
duckdb / vortex-file-compressed (0.790x ✅, 22↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚀 174619073 216187314 0.81
tpch_q02/duckdb:vortex-file-compressed 🚀 53458841 69766178 0.77
tpch_q03/duckdb:vortex-file-compressed 🚀 134116830 176147293 0.76
tpch_q04/duckdb:vortex-file-compressed 🚀 159782468 217250860 0.74
tpch_q05/duckdb:vortex-file-compressed 🚀 130624524 178939972 0.73
tpch_q06/duckdb:vortex-file-compressed 🚀 49333947 59406451 0.83
tpch_q07/duckdb:vortex-file-compressed 🚀 153672103 202794156 0.76
tpch_q08/duckdb:vortex-file-compressed 🚀 178342988 250668313 0.71
tpch_q09/duckdb:vortex-file-compressed 🚀 335754359 422164020 0.80
tpch_q10/duckdb:vortex-file-compressed 🚀 160394380 205000918 0.78
tpch_q11/duckdb:vortex-file-compressed 🚀 35300131 44036366 0.80
tpch_q12/duckdb:vortex-file-compressed 🚀 99524819 125235102 0.79
tpch_q13/duckdb:vortex-file-compressed 🚀 242170000 301554639 0.80
tpch_q14/duckdb:vortex-file-compressed 🚀 70464284 89013309 0.79
tpch_q15/duckdb:vortex-file-compressed 🚀 96110192 122851347 0.78
tpch_q16/duckdb:vortex-file-compressed 🚀 80133853 97217513 0.82
tpch_q17/duckdb:vortex-file-compressed 🚀 100229203 126453502 0.79
tpch_q18/duckdb:vortex-file-compressed 🚀 301232887 369391923 0.82
tpch_q19/duckdb:vortex-file-compressed 🚀 90597912 105344786 0.86
tpch_q20/duckdb:vortex-file-compressed 🚀 165778492 203394752 0.82
tpch_q21/duckdb:vortex-file-compressed 🚀 591488547 741244979 0.80
tpch_q22/duckdb:vortex-file-compressed 🚀 77028266 90734668 0.85
duckdb / vortex-compact (0.832x ✅, 22↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 🚀 227860606 273200128 0.83
tpch_q02/duckdb:vortex-compact 🚀 57386536 70197129 0.82
tpch_q03/duckdb:vortex-compact 🚀 139368340 175100955 0.80
tpch_q04/duckdb:vortex-compact 🚀 175846498 214485617 0.82
tpch_q05/duckdb:vortex-compact 🚀 145635774 181478430 0.80
tpch_q06/duckdb:vortex-compact 🚀 83738130 101231579 0.83
tpch_q07/duckdb:vortex-compact 🚀 204620732 250453776 0.82
tpch_q08/duckdb:vortex-compact 🚀 189058118 239843981 0.79
tpch_q09/duckdb:vortex-compact 🚀 362904975 434119592 0.84
tpch_q10/duckdb:vortex-compact 🚀 184506609 222946704 0.83
tpch_q11/duckdb:vortex-compact 🚀 41393997 49434902 0.84
tpch_q12/duckdb:vortex-compact 🚀 201522569 240743768 0.84
tpch_q13/duckdb:vortex-compact 🚀 294906620 352738789 0.84
tpch_q14/duckdb:vortex-compact 🚀 101409766 125255473 0.81
tpch_q15/duckdb:vortex-compact 🚀 117183497 142473283 0.82
tpch_q16/duckdb:vortex-compact 🚀 86592000 97931825 0.88
tpch_q17/duckdb:vortex-compact 🚀 118281375 143345795 0.83
tpch_q18/duckdb:vortex-compact 🚀 296648600 345007452 0.86
tpch_q19/duckdb:vortex-compact 🚀 115556608 130268922 0.89
tpch_q20/duckdb:vortex-compact 🚀 206271863 250340057 0.82
tpch_q21/duckdb:vortex-compact 🚀 616773595 741455311 0.83
tpch_q22/duckdb:vortex-compact 🚀 89598073 100823488 0.89
duckdb / parquet (0.879x ✅, 18↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚀 255769025 289497611 0.88
tpch_q02/duckdb:parquet 🚀 98579050 109969767 0.90
tpch_q03/duckdb:parquet 🚀 203837536 231138035 0.88
tpch_q04/duckdb:parquet 🚀 129511819 146984187 0.88
tpch_q05/duckdb:parquet 🚀 212923584 242006062 0.88
tpch_q06/duckdb:parquet 66157588 72517411 0.91
tpch_q07/duckdb:parquet 🚀 177801063 206690817 0.86
tpch_q08/duckdb:parquet 🚀 251511074 300978821 0.84
tpch_q09/duckdb:parquet 🚀 502324698 579416489 0.87
tpch_q10/duckdb:parquet 609666535 668913967 0.91
tpch_q11/duckdb:parquet 🚀 56620558 67153345 0.84
tpch_q12/duckdb:parquet 🚀 124017718 139841710 0.89
tpch_q13/duckdb:parquet 🚀 443045800 507037484 0.87
tpch_q14/duckdb:parquet 🚀 171762162 195005635 0.88
tpch_q15/duckdb:parquet 🚀 95465691 110652138 0.86
tpch_q16/duckdb:parquet 🚀 159948673 180360397 0.89
tpch_q17/duckdb:parquet 🚀 175600912 195894849 0.90
tpch_q18/duckdb:parquet 🚀 352313409 405398026 0.87
tpch_q19/duckdb:parquet 🚀 286219296 321498221 0.89
tpch_q20/duckdb:parquet 230482917 253437569 0.91
tpch_q21/duckdb:parquet 🚀 551159314 679822664 0.81
tpch_q22/duckdb:parquet 290624155 316519673 0.92
duckdb / duckdb (0.941x ➖, 8↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 117190830 123360154 0.95
tpch_q02/duckdb:duckdb 49183149 49155672 1.00
tpch_q03/duckdb:duckdb 🚀 96974088 108178648 0.90
tpch_q04/duckdb:duckdb 🚀 130995921 150689051 0.87
tpch_q05/duckdb:duckdb 🚀 109474391 128369130 0.85
tpch_q06/duckdb:duckdb 🚀 37413147 42860350 0.87
tpch_q07/duckdb:duckdb 86823964 90279143 0.96
tpch_q08/duckdb:duckdb 109905206 118077332 0.93
tpch_q09/duckdb:duckdb 🚀 277236102 309244738 0.90
tpch_q10/duckdb:duckdb 🚀 201608421 231341373 0.87
tpch_q11/duckdb:duckdb 🚀 15192893 17171086 0.88
tpch_q12/duckdb:duckdb 🚀 85235085 95705326 0.89
tpch_q13/duckdb:duckdb 220166971 237550435 0.93
tpch_q14/duckdb:duckdb 70557774 70735238 1.00
tpch_q15/duckdb:duckdb 77830673 79127734 0.98
tpch_q16/duckdb:duckdb 73248355 73743165 0.99
tpch_q17/duckdb:duckdb 84675510 85439160 0.99
tpch_q18/duckdb:duckdb 211662505 211494062 1.00
tpch_q19/duckdb:duckdb 116223682 117045356 0.99
tpch_q20/duckdb:duckdb 111802426 112592712 0.99
tpch_q21/duckdb:duckdb 294371690 287515524 1.02
tpch_q22/duckdb:duckdb 67266048 70607541 0.95
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +0.3% -2.7% +3.1% +10.0% ➖ noise
1 datafusion:vortex-compact -1.4% -2.7% +1.3% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +0.6% -2.7% +3.4% +10.0% ➖ noise
1 duckdb:duckdb -5.0% -2.7% -2.4% +10.0% ➖ noise
1 duckdb:vortex-compact -16.6% -2.7% -14.3% +10.0% ✅ faster
1 duckdb:vortex-file-compressed -19.2% -2.7% -17.0% +10.0% ✅ faster
2 datafusion:arrow +1.0% -5.3% +6.6% +10.0% ➖ noise
2 datafusion:vortex-compact -4.1% -5.3% +1.2% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -0.6% -5.3% +4.9% +10.0% ➖ noise
2 duckdb:duckdb +0.1% -5.3% +5.6% +10.0% ➖ noise
2 duckdb:vortex-compact -18.2% -5.3% -13.7% +10.0% ✅ faster
2 duckdb:vortex-file-compressed -23.4% -5.3% -19.1% +10.0% ✅ faster
3 datafusion:arrow -2.1% -6.1% +4.2% +10.0% ➖ noise
3 datafusion:vortex-compact -1.6% -6.1% +4.8% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -1.9% -6.1% +4.5% +10.0% ➖ noise
3 duckdb:duckdb -10.4% -6.1% -4.6% +10.0% ➖ noise
3 duckdb:vortex-compact -20.4% -6.1% -15.3% +10.0% ✅ faster
3 duckdb:vortex-file-compressed -23.9% -6.1% -18.9% +10.0% ✅ faster
4 datafusion:arrow -2.1% -6.4% +4.5% +10.0% ➖ noise
4 datafusion:vortex-compact -0.6% -6.4% +6.1% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -0.1% -6.4% +6.7% +10.0% ➖ noise
4 duckdb:duckdb -13.1% -6.4% -7.2% +10.0% ➖ noise
4 duckdb:vortex-compact -18.0% -6.4% -12.4% +10.0% ✅ faster
4 duckdb:vortex-file-compressed -26.5% -6.4% -21.5% +10.0% ✅ faster
5 datafusion:arrow -0.4% -6.3% +6.3% +10.0% ➖ noise
5 datafusion:vortex-compact -2.2% -6.3% +4.4% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -1.0% -6.3% +5.7% +10.0% ➖ noise
5 duckdb:duckdb -14.7% -6.3% -9.0% +10.0% ➖ noise
5 duckdb:vortex-compact -19.8% -6.3% -14.3% +10.0% ✅ faster
5 duckdb:vortex-file-compressed -27.0% -6.3% -22.1% +10.0% ✅ faster
6 datafusion:arrow -1.3% -1.4% +0.1% +10.0% ➖ noise
6 datafusion:vortex-compact -0.7% -1.4% +0.7% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -1.3% -1.4% +0.1% +10.0% ➖ noise
6 duckdb:duckdb -12.7% -1.4% -11.5% +12.9% ✅ faster
6 duckdb:vortex-compact -17.3% -1.4% -16.1% +10.0% ✅ faster
6 duckdb:vortex-file-compressed -17.0% -1.4% -15.8% +10.0% ✅ faster
7 datafusion:arrow -0.8% -7.5% +7.2% +10.0% ➖ noise
7 datafusion:vortex-compact -2.0% -7.5% +5.9% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -0.5% -7.5% +7.5% +10.0% ➖ noise
7 duckdb:duckdb -3.8% -7.5% +4.0% +10.0% ➖ noise
7 duckdb:vortex-compact -18.3% -7.5% -11.7% +10.0% ✅ faster
7 duckdb:vortex-file-compressed -24.2% -7.5% -18.1% +10.0% ✅ faster
8 datafusion:arrow -1.0% -8.7% +8.4% +10.0% ➖ noise
8 datafusion:vortex-compact -3.6% -8.7% +5.6% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -0.4% -8.7% +9.1% +10.0% ➖ noise
8 duckdb:duckdb -6.9% -8.7% +1.9% +10.0% ➖ noise
8 duckdb:vortex-compact -21.2% -8.7% -13.7% +10.0% ✅ faster
8 duckdb:vortex-file-compressed -28.9% -8.7% -22.1% +10.0% ✅ faster
9 datafusion:arrow -1.0% -6.9% +6.3% +10.0% ➖ noise
9 datafusion:vortex-compact -2.5% -6.9% +4.7% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -1.3% -6.9% +6.0% +10.0% ➖ noise
9 duckdb:duckdb -10.4% -6.9% -3.7% +10.0% ➖ noise
9 duckdb:vortex-compact -16.4% -6.9% -10.2% +10.0% ✅ faster
9 duckdb:vortex-file-compressed -20.5% -6.9% -14.6% +10.0% ✅ faster
10 datafusion:arrow -0.5% -5.3% +5.1% +10.0% ➖ noise
10 datafusion:vortex-compact -2.7% -5.3% +2.8% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +0.7% -5.3% +6.3% +10.0% ➖ noise
10 duckdb:duckdb -12.9% -5.3% -8.0% +10.0% ➖ noise
10 duckdb:vortex-compact -17.2% -5.3% -12.6% +10.0% ✅ faster
10 duckdb:vortex-file-compressed -21.8% -5.3% -17.4% +10.0% ✅ faster
11 datafusion:arrow -0.9% -8.5% +8.3% +10.0% ➖ noise
11 datafusion:vortex-compact -4.0% -8.5% +4.9% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -1.2% -8.5% +7.9% +10.0% ➖ noise
11 duckdb:duckdb -11.5% -8.5% -3.3% +13.1% ➖ noise
11 duckdb:vortex-compact -16.3% -8.5% -8.5% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -19.8% -8.5% -12.4% +10.0% ✅ faster
12 datafusion:arrow -1.3% -3.5% +2.2% +27.7% ➖ noise
12 datafusion:vortex-compact -1.8% -3.5% +1.7% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -2.8% -3.5% +0.7% +10.0% ➖ noise
12 duckdb:duckdb -10.9% -3.5% -7.8% +10.0% ➖ noise
12 duckdb:vortex-compact -16.3% -3.5% -13.3% +10.0% ✅ faster
12 duckdb:vortex-file-compressed -20.5% -3.5% -17.7% +10.0% ✅ faster
13 datafusion:arrow -1.3% -6.1% +5.1% +10.0% ➖ noise
13 datafusion:vortex-compact -1.3% -6.1% +5.1% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -0.4% -6.1% +6.0% +10.0% ➖ noise
13 duckdb:duckdb -7.3% -6.1% -1.3% +10.0% ➖ noise
13 duckdb:vortex-compact -16.4% -6.1% -11.0% +10.0% ✅ faster
13 duckdb:vortex-file-compressed -19.7% -6.1% -14.5% +10.0% ✅ faster
14 datafusion:arrow -0.1% -6.0% +6.3% +10.0% ➖ noise
14 datafusion:vortex-compact -1.5% -6.0% +4.8% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -1.7% -6.0% +4.5% +10.0% ➖ noise
14 duckdb:duckdb -0.3% -6.0% +6.1% +10.0% ➖ noise
14 duckdb:vortex-compact -19.0% -6.0% -13.9% +10.0% ✅ faster
14 duckdb:vortex-file-compressed -20.8% -6.0% -15.8% +10.0% ✅ faster
15 datafusion:arrow -0.4% -7.4% +7.6% +10.0% ➖ noise
15 datafusion:vortex-compact -0.5% -7.4% +7.5% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -3.7% -7.4% +4.1% +10.0% ➖ noise
15 duckdb:duckdb -1.6% -7.4% +6.2% +10.0% ➖ noise
15 duckdb:vortex-compact -17.8% -7.4% -11.2% +10.0% ✅ faster
15 duckdb:vortex-file-compressed -21.8% -7.4% -15.5% +10.0% ✅ faster
16 datafusion:arrow -1.7% -6.9% +5.6% +10.0% ➖ noise
16 datafusion:vortex-compact +0.0% -6.9% +7.5% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +1.3% -6.9% +8.8% +10.0% ➖ noise
16 duckdb:duckdb -0.7% -6.9% +6.7% +10.0% ➖ noise
16 duckdb:vortex-compact -11.6% -6.9% -5.0% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -17.6% -6.9% -11.4% +10.0% ✅ faster
17 datafusion:arrow -0.9% -5.8% +5.2% +10.0% ➖ noise
17 datafusion:vortex-compact -0.7% -5.8% +5.4% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -0.8% -5.8% +5.3% +10.0% ➖ noise
17 duckdb:duckdb -0.9% -5.8% +5.2% +10.0% ➖ noise
17 duckdb:vortex-compact -17.5% -5.8% -12.4% +10.0% ✅ faster
17 duckdb:vortex-file-compressed -20.7% -5.8% -15.8% +10.0% ✅ faster
18 datafusion:arrow -2.1% -7.2% +5.6% +10.0% ➖ noise
18 datafusion:vortex-compact -1.4% -7.2% +6.3% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -0.4% -7.2% +7.3% +10.0% ➖ noise
18 duckdb:duckdb +0.1% -7.2% +7.9% +10.0% ➖ noise
18 duckdb:vortex-compact -14.0% -7.2% -7.3% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -18.5% -7.2% -12.1% +10.0% ✅ faster
19 datafusion:arrow -2.2% -6.8% +5.0% +10.0% ➖ noise
19 datafusion:vortex-compact -6.1% -6.8% +0.8% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +0.4% -6.8% +7.7% +10.0% ➖ noise
19 duckdb:duckdb -0.7% -6.8% +6.6% +10.0% ➖ noise
19 duckdb:vortex-compact -11.3% -6.8% -4.8% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -14.0% -6.8% -7.7% +10.0% ➖ noise
20 datafusion:arrow -0.6% -5.1% +4.7% +10.0% ➖ noise
20 datafusion:vortex-compact -18.6% -5.1% -14.2% +10.0% ✅ faster
20 datafusion:vortex-file-compressed -0.8% -5.1% +4.5% +10.0% ➖ noise
20 duckdb:duckdb -0.7% -5.1% +4.6% +10.0% ➖ noise
20 duckdb:vortex-compact -17.6% -5.1% -13.2% +10.0% ✅ faster
20 duckdb:vortex-file-compressed -18.5% -5.1% -14.1% +10.0% ✅ faster
21 datafusion:arrow -0.4% -9.9% +10.5% +10.0% 🚨 regression
21 datafusion:vortex-compact -21.4% -9.9% -12.7% +10.0% ✅ faster
21 datafusion:vortex-file-compressed -4.4% -9.9% +6.1% +10.0% ➖ noise
21 duckdb:duckdb +2.4% -9.9% +13.6% +10.0% 🚨 regression
21 duckdb:vortex-compact -16.8% -9.9% -7.7% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -20.2% -9.9% -11.4% +10.0% ✅ faster
22 datafusion:arrow +0.2% -4.6% +5.0% +10.0% ➖ noise
22 datafusion:vortex-compact -18.6% -4.6% -14.7% +10.0% ✅ faster
22 datafusion:vortex-file-compressed -2.5% -4.6% +2.1% +10.0% ➖ noise
22 duckdb:duckdb -4.7% -4.6% -0.2% +10.0% ➖ noise
22 duckdb:vortex-compact -11.1% -4.6% -6.9% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -15.1% -4.6% -11.1% +10.0% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 16, 2026

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 16, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Vortex (geomean): 0.969x ➖
Parquet (geomean): 0.967x ➖
Shifts: Parquet (control) -3.3% · Median polish -2.1%

duckdb / vortex-file-compressed (0.962x ➖, 1↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 10745704 11242158 0.96
statpopgen_q01/duckdb:vortex-file-compressed 🚀 45440426 57110973 0.80
statpopgen_q02/duckdb:vortex-file-compressed 1315004915 1322959392 0.99
statpopgen_q03/duckdb:vortex-file-compressed 3066937170 3134881305 0.98
statpopgen_q04/duckdb:vortex-file-compressed 3103184824 3200076126 0.97
statpopgen_q05/duckdb:vortex-file-compressed 1397794260 1408403351 0.99
statpopgen_q06/duckdb:vortex-file-compressed 2068864173 2100702012 0.98
statpopgen_q07/duckdb:vortex-file-compressed 341670547 344962071 0.99
statpopgen_q08/duckdb:vortex-file-compressed 358414851 365843100 0.98
statpopgen_q09/duckdb:vortex-file-compressed 2875867977 2930261630 0.98
statpopgen_q10/duckdb:vortex-file-compressed 4565219839 4664183429 0.98
duckdb / vortex-compact (0.976x ➖, 0↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 10569292 11325175 0.93
statpopgen_q01/duckdb:vortex-compact 167591517 168593055 0.99
statpopgen_q02/duckdb:vortex-compact 1818668318 1828142158 0.99
statpopgen_q03/duckdb:vortex-compact 3431149202 3542407284 0.97
statpopgen_q04/duckdb:vortex-compact 3515877442 3569405377 0.99
statpopgen_q05/duckdb:vortex-compact 1803395600 1846376227 0.98
statpopgen_q06/duckdb:vortex-compact 2653531348 2705134368 0.98
statpopgen_q07/duckdb:vortex-compact 930858856 949001926 0.98
statpopgen_q08/duckdb:vortex-compact 966252304 989788781 0.98
statpopgen_q09/duckdb:vortex-compact 3291474604 3397313186 0.97
statpopgen_q10/duckdb:vortex-compact 5374139469 5486938848 0.98
duckdb / parquet (0.967x ➖, 0↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 317561066 333385571 0.95
statpopgen_q01/duckdb:parquet 404967015 419339148 0.97
statpopgen_q02/duckdb:parquet 992480731 1040496239 0.95
statpopgen_q03/duckdb:parquet 1515168176 1515077141 1.00
statpopgen_q04/duckdb:parquet 1507613550 1540229205 0.98
statpopgen_q05/duckdb:parquet 995056187 1021678561 0.97
statpopgen_q06/duckdb:parquet 1492118770 1535550500 0.97
statpopgen_q07/duckdb:parquet 1277340557 1363128364 0.94
statpopgen_q08/duckdb:parquet 1284366923 1366680350 0.94
statpopgen_q09/duckdb:parquet 1365072004 1382879655 0.99
statpopgen_q10/duckdb:parquet 2641943383 2699969622 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -6.7% -4.7% -2.0% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -4.4% -4.7% +0.3% +10.0% ➖ noise
1 duckdb:vortex-compact -0.6% -3.4% +2.9% +27.5% ➖ noise
1 duckdb:vortex-file-compressed -20.4% -3.4% -17.6% +253.4% ➖ noise
2 duckdb:vortex-compact -0.5% -4.6% +4.3% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -0.6% -4.6% +4.2% +10.0% ➖ noise
3 duckdb:vortex-compact -3.1% +0.0% -3.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -2.2% +0.0% -2.2% +10.0% ➖ noise
4 duckdb:vortex-compact -1.5% -2.1% +0.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -3.0% -2.1% -0.9% +10.0% ➖ noise
5 duckdb:vortex-compact -2.3% -2.6% +0.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -0.8% -2.6% +1.9% +10.0% ➖ noise
6 duckdb:vortex-compact -1.9% -2.8% +0.9% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -1.5% -2.8% +1.4% +10.0% ➖ noise
7 duckdb:vortex-compact -1.9% -6.3% +4.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -1.0% -6.3% +5.7% +10.0% ➖ noise
8 duckdb:vortex-compact -2.4% -6.0% +3.9% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -2.0% -6.0% +4.2% +10.0% ➖ noise
9 duckdb:vortex-compact -3.1% -1.3% -1.9% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -1.9% -1.3% -0.6% +10.0% ➖ noise
10 duckdb:vortex-compact -2.1% -2.1% +0.1% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -2.1% -2.1% +0.0% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 16, 2026

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 16, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.9%
Vortex (geomean): 0.897x ✅
Parquet (geomean): 0.936x ➖
Shifts: Parquet (control) -6.4% · Median polish -5.2%

datafusion / vortex-file-compressed (0.891x ✅, 19↑ 2↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1867799 1881822 0.99
clickbench_q01/datafusion:vortex-file-compressed 🚨 15798686 14106763 1.12
clickbench_q02/datafusion:vortex-file-compressed 34785519 37365593 0.93
clickbench_q03/datafusion:vortex-file-compressed 🚀 38323981 43778957 0.88
clickbench_q04/datafusion:vortex-file-compressed 304229895 309015135 0.98
clickbench_q05/datafusion:vortex-file-compressed 320691748 346878124 0.92
clickbench_q06/datafusion:vortex-file-compressed 🚀 1887526 3751923 0.50
clickbench_q07/datafusion:vortex-file-compressed 🚀 20048591 28182027 0.71
clickbench_q08/datafusion:vortex-file-compressed 🚀 387813607 473632942 0.82
clickbench_q09/datafusion:vortex-file-compressed 🚀 563666022 723140693 0.78
clickbench_q10/datafusion:vortex-file-compressed 75484258 74123246 1.02
clickbench_q11/datafusion:vortex-file-compressed 84655318 85651197 0.99
clickbench_q12/datafusion:vortex-file-compressed 270850557 288199066 0.94
clickbench_q13/datafusion:vortex-file-compressed 422572417 457372509 0.92
clickbench_q14/datafusion:vortex-file-compressed 264161342 281521551 0.94
clickbench_q15/datafusion:vortex-file-compressed 359638204 366106448 0.98
clickbench_q16/datafusion:vortex-file-compressed 699957711 744990673 0.94
clickbench_q17/datafusion:vortex-file-compressed 🚀 686959684 822492958 0.84
clickbench_q18/datafusion:vortex-file-compressed 1394877089 1494356091 0.93
clickbench_q19/datafusion:vortex-file-compressed 🚨 29443830 25936746 1.14
clickbench_q20/datafusion:vortex-file-compressed 359376493 394036288 0.91
clickbench_q21/datafusion:vortex-file-compressed 408383559 424965984 0.96
clickbench_q22/datafusion:vortex-file-compressed 🚀 497413287 646447537 0.77
clickbench_q23/datafusion:vortex-file-compressed 🚀 792108208 1014401310 0.78
clickbench_q24/datafusion:vortex-file-compressed 🚀 47306146 52710209 0.90
clickbench_q25/datafusion:vortex-file-compressed 76676524 76967957 1.00
clickbench_q26/datafusion:vortex-file-compressed 🚀 47177867 53632528 0.88
clickbench_q27/datafusion:vortex-file-compressed 791933205 822450176 0.96
clickbench_q28/datafusion:vortex-file-compressed 6757571851 7014940008 0.96
clickbench_q29/datafusion:vortex-file-compressed 242246819 259011179 0.94
clickbench_q30/datafusion:vortex-file-compressed 🚀 245533603 294057233 0.83
clickbench_q31/datafusion:vortex-file-compressed 276269368 303624718 0.91
clickbench_q32/datafusion:vortex-file-compressed 1406331332 1476616957 0.95
clickbench_q33/datafusion:vortex-file-compressed 🚀 1394412771 1571113891 0.89
clickbench_q34/datafusion:vortex-file-compressed 1403337897 1539908876 0.91
clickbench_q35/datafusion:vortex-file-compressed 516139822 566306437 0.91
clickbench_q36/datafusion:vortex-file-compressed 🚀 81653924 93320026 0.87
clickbench_q37/datafusion:vortex-file-compressed 🚀 39807613 47842480 0.83
clickbench_q38/datafusion:vortex-file-compressed 🚀 23166029 25770557 0.90
clickbench_q39/datafusion:vortex-file-compressed 🚀 143674059 165833629 0.87
clickbench_q40/datafusion:vortex-file-compressed 🚀 17986439 21540181 0.84
clickbench_q41/datafusion:vortex-file-compressed 🚀 16685611 21400672 0.78
clickbench_q42/datafusion:vortex-file-compressed 🚀 18696929 24218079 0.77
datafusion / parquet (0.950x ➖, 6↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 2163054 2145264 1.01
clickbench_q01/datafusion:parquet 21218047 20508890 1.03
clickbench_q02/datafusion:parquet 55061315 55211138 1.00
clickbench_q03/datafusion:parquet 46080225 47114130 0.98
clickbench_q04/datafusion:parquet 322107594 332387001 0.97
clickbench_q05/datafusion:parquet 367826823 378525838 0.97
clickbench_q06/datafusion:parquet 1716054 1809190 0.95
clickbench_q07/datafusion:parquet 25407235 25524648 1.00
clickbench_q08/datafusion:parquet 413676266 440719919 0.94
clickbench_q09/datafusion:parquet 644556354 691653885 0.93
clickbench_q10/datafusion:parquet 110419855 114815827 0.96
clickbench_q11/datafusion:parquet 134295713 139805084 0.96
clickbench_q12/datafusion:parquet 360597998 362962616 0.99
clickbench_q13/datafusion:parquet 506813568 558999080 0.91
clickbench_q14/datafusion:parquet 365708476 368552982 0.99
clickbench_q15/datafusion:parquet 374727642 391864439 0.96
clickbench_q16/datafusion:parquet 694145017 732864450 0.95
clickbench_q17/datafusion:parquet 688320473 735232585 0.94
clickbench_q18/datafusion:parquet 1439733133 1552055280 0.93
clickbench_q19/datafusion:parquet 🚀 35065423 39586844 0.89
clickbench_q20/datafusion:parquet 643263963 653713608 0.98
clickbench_q21/datafusion:parquet 670014825 712034285 0.94
clickbench_q22/datafusion:parquet 967721032 1002272513 0.97
clickbench_q23/datafusion:parquet 3662260541 3994087840 0.92
clickbench_q24/datafusion:parquet 🚀 86929552 97862689 0.89
clickbench_q25/datafusion:parquet 🚀 138513814 165886333 0.83
clickbench_q26/datafusion:parquet 87431848 95802162 0.91
clickbench_q27/datafusion:parquet 🚀 1055187038 1225985230 0.86
clickbench_q28/datafusion:parquet 6691920187 6884758016 0.97
clickbench_q29/datafusion:parquet 240765377 243184032 0.99
clickbench_q30/datafusion:parquet 374108069 396728937 0.94
clickbench_q31/datafusion:parquet 401727132 397740342 1.01
clickbench_q32/datafusion:parquet 1281988045 1388945261 0.92
clickbench_q33/datafusion:parquet 🚀 1577849768 1792049991 0.88
clickbench_q34/datafusion:parquet 🚀 1531713122 1753391256 0.87
clickbench_q35/datafusion:parquet 527681151 548486145 0.96
clickbench_q36/datafusion:parquet 149238812 148554830 1.00
clickbench_q37/datafusion:parquet 61925931 62348177 0.99
clickbench_q38/datafusion:parquet 88791309 91020405 0.98
clickbench_q39/datafusion:parquet 268050833 275119455 0.97
clickbench_q40/datafusion:parquet 33263266 35017517 0.95
clickbench_q41/datafusion:parquet 30167128 30246284 1.00
clickbench_q42/datafusion:parquet 31105413 34178054 0.91
duckdb / vortex-file-compressed (0.903x ➖, 19↑ 1↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚀 6130112 7498142 0.82
clickbench_q01/duckdb:vortex-file-compressed 🚀 14867107 17477204 0.85
clickbench_q02/duckdb:vortex-file-compressed 27152590 27265310 1.00
clickbench_q03/duckdb:vortex-file-compressed 30938750 30798984 1.00
clickbench_q04/duckdb:vortex-file-compressed 🚀 186952871 208574478 0.90
clickbench_q05/duckdb:vortex-file-compressed 🚀 178898178 221795941 0.81
clickbench_q06/duckdb:vortex-file-compressed 🚀 21339862 24421597 0.87
clickbench_q07/duckdb:vortex-file-compressed 17885506 18127387 0.99
clickbench_q08/duckdb:vortex-file-compressed 🚀 263311892 295599665 0.89
clickbench_q09/duckdb:vortex-file-compressed 352678942 383268762 0.92
clickbench_q10/duckdb:vortex-file-compressed 🚀 73244462 89881094 0.81
clickbench_q11/duckdb:vortex-file-compressed 83019010 85630448 0.97
clickbench_q12/duckdb:vortex-file-compressed 🚀 203619394 252990749 0.80
clickbench_q13/duckdb:vortex-file-compressed 🚀 406152084 569640478 0.71
clickbench_q14/duckdb:vortex-file-compressed 🚀 237702351 288373676 0.82
clickbench_q15/duckdb:vortex-file-compressed 244715779 258435713 0.95
clickbench_q16/duckdb:vortex-file-compressed 🚀 658370518 754305730 0.87
clickbench_q17/duckdb:vortex-file-compressed 507232135 559869889 0.91
clickbench_q18/duckdb:vortex-file-compressed 1202226198 1249398029 0.96
clickbench_q19/duckdb:vortex-file-compressed 24030608 23261714 1.03
clickbench_q20/duckdb:vortex-file-compressed 374976328 382412396 0.98
clickbench_q21/duckdb:vortex-file-compressed 404223248 408444715 0.99
clickbench_q22/duckdb:vortex-file-compressed 🚨 698530131 574027006 1.22
clickbench_q23/duckdb:vortex-file-compressed 🚀 928698512 1801098100 0.52
clickbench_q24/duckdb:vortex-file-compressed 54251028 54319554 1.00
clickbench_q25/duckdb:vortex-file-compressed 79592063 82030208 0.97
clickbench_q26/duckdb:vortex-file-compressed 49851813 50718714 0.98
clickbench_q27/duckdb:vortex-file-compressed 496414807 551283099 0.90
clickbench_q28/duckdb:vortex-file-compressed 2986677587 3037812762 0.98
clickbench_q29/duckdb:vortex-file-compressed 29536459 32580255 0.91
clickbench_q30/duckdb:vortex-file-compressed 200896099 206368881 0.97
clickbench_q31/duckdb:vortex-file-compressed 284767662 298490149 0.95
clickbench_q32/duckdb:vortex-file-compressed 1371015187 1447679746 0.95
clickbench_q33/duckdb:vortex-file-compressed 1448238675 1595074688 0.91
clickbench_q34/duckdb:vortex-file-compressed 🚀 1519326239 1756390076 0.87
clickbench_q35/duckdb:vortex-file-compressed 381503780 387087612 0.99
clickbench_q36/duckdb:vortex-file-compressed 🚀 29806994 33993202 0.88
clickbench_q37/duckdb:vortex-file-compressed 🚀 22795015 25774753 0.88
clickbench_q38/duckdb:vortex-file-compressed 🚀 24254674 27258567 0.89
clickbench_q39/duckdb:vortex-file-compressed 45437813 47705955 0.95
clickbench_q40/duckdb:vortex-file-compressed 🚀 24006999 27717770 0.87
clickbench_q41/duckdb:vortex-file-compressed 🚀 22520977 26916105 0.84
clickbench_q42/duckdb:vortex-file-compressed 🚀 22844498 27060584 0.84
duckdb / parquet (0.922x ➖, 14↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 🚀 23790374 31738813 0.75
clickbench_q01/duckdb:parquet 27081765 27520607 0.98
clickbench_q02/duckdb:parquet 47592185 48164490 0.99
clickbench_q03/duckdb:parquet 37895901 39591204 0.96
clickbench_q04/duckdb:parquet 200912412 216918466 0.93
clickbench_q05/duckdb:parquet 268187971 287387641 0.93
clickbench_q06/duckdb:parquet 45007166 46843255 0.96
clickbench_q07/duckdb:parquet 🚀 29066876 33086443 0.88
clickbench_q08/duckdb:parquet 263366588 288867426 0.91
clickbench_q09/duckdb:parquet 🚀 395530023 468695534 0.84
clickbench_q10/duckdb:parquet 79570965 84768539 0.94
clickbench_q11/duckdb:parquet 98536091 103018716 0.96
clickbench_q12/duckdb:parquet 291754469 304537825 0.96
clickbench_q13/duckdb:parquet 480739144 516341275 0.93
clickbench_q14/duckdb:parquet 317348935 331071529 0.96
clickbench_q15/duckdb:parquet 263214961 268949324 0.98
clickbench_q16/duckdb:parquet 🚀 652201085 768703253 0.85
clickbench_q17/duckdb:parquet 🚀 532300261 614149831 0.87
clickbench_q18/duckdb:parquet 🚀 1048849521 1165639704 0.90
clickbench_q19/duckdb:parquet 24676176 26704909 0.92
clickbench_q20/duckdb:parquet 417330285 445079878 0.94
clickbench_q21/duckdb:parquet 534951405 561380485 0.95
clickbench_q22/duckdb:parquet 920793668 956401840 0.96
clickbench_q23/duckdb:parquet 287696186 316876798 0.91
clickbench_q24/duckdb:parquet 70225781 70029370 1.00
clickbench_q25/duckdb:parquet 156030010 158323844 0.99
clickbench_q26/duckdb:parquet 47322418 50113400 0.94
clickbench_q27/duckdb:parquet 643952714 673880790 0.96
clickbench_q28/duckdb:parquet 4793255910 4859620274 0.99
clickbench_q29/duckdb:parquet 40491872 43439565 0.93
clickbench_q30/duckdb:parquet 298675448 329373617 0.91
clickbench_q31/duckdb:parquet 🚀 358503793 413155283 0.87
clickbench_q32/duckdb:parquet 🚀 1220578603 1392588893 0.88
clickbench_q33/duckdb:parquet 🚀 1291058409 1555922424 0.83
clickbench_q34/duckdb:parquet 🚀 1295145585 1448218028 0.89
clickbench_q35/duckdb:parquet 363582170 373118713 0.97
clickbench_q36/duckdb:parquet 🚀 43980890 51747611 0.85
clickbench_q37/duckdb:parquet 32630149 32877087 0.99
clickbench_q38/duckdb:parquet 🚀 30719475 37289352 0.82
clickbench_q39/duckdb:parquet 🚀 73877248 91080239 0.81
clickbench_q40/duckdb:parquet 🚀 16569498 19559016 0.85
clickbench_q41/duckdb:parquet 18275417 17292597 1.06
clickbench_q42/duckdb:parquet 21204351 20455051 1.04
duckdb / duckdb (0.991x ➖, 4↑ 2↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 18905399 17363623 1.09
clickbench_q01/duckdb:duckdb 35063470 33071732 1.06
clickbench_q02/duckdb:duckdb 47752131 47134582 1.01
clickbench_q03/duckdb:duckdb 48600306 48490891 1.00
clickbench_q04/duckdb:duckdb 186860484 187608444 1.00
clickbench_q05/duckdb:duckdb 268621545 277273584 0.97
clickbench_q06/duckdb:duckdb 🚀 29692033 35160000 0.84
clickbench_q07/duckdb:duckdb 37402137 35063224 1.07
clickbench_q08/duckdb:duckdb 251397098 258697233 0.97
clickbench_q09/duckdb:duckdb 367487829 381954371 0.96
clickbench_q10/duckdb:duckdb 99591703 98951973 1.01
clickbench_q11/duckdb:duckdb 108233325 108913234 0.99
clickbench_q12/duckdb:duckdb 237682632 243289839 0.98
clickbench_q13/duckdb:duckdb 490715643 513621289 0.96
clickbench_q14/duckdb:duckdb 279002567 290923983 0.96
clickbench_q15/duckdb:duckdb 221047353 220831890 1.00
clickbench_q16/duckdb:duckdb 648562678 711532514 0.91
clickbench_q17/duckdb:duckdb 555285448 592797070 0.94
clickbench_q18/duckdb:duckdb 1228049819 1343340501 0.91
clickbench_q19/duckdb:duckdb 🚨 37261953 33785381 1.10
clickbench_q20/duckdb:duckdb 🚀 878701290 1013849603 0.87
clickbench_q21/duckdb:duckdb 1014339367 1079083896 0.94
clickbench_q22/duckdb:duckdb 1077871041 1133411013 0.95
clickbench_q23/duckdb:duckdb 260402328 256897764 1.01
clickbench_q24/duckdb:duckdb 63707001 60707230 1.05
clickbench_q25/duckdb:duckdb 140498117 142252485 0.99
clickbench_q26/duckdb:duckdb 63315024 59871699 1.06
clickbench_q27/duckdb:duckdb 🚀 938495011 1068878491 0.88
clickbench_q28/duckdb:duckdb 4620380254 4706484709 0.98
clickbench_q29/duckdb:duckdb 50861441 48809338 1.04
clickbench_q30/duckdb:duckdb 260110254 273083991 0.95
clickbench_q31/duckdb:duckdb 🚀 406972021 458733017 0.89
clickbench_q32/duckdb:duckdb 1522044000 1521180119 1.00
clickbench_q33/duckdb:duckdb 2085447766 2040289908 1.02
clickbench_q34/duckdb:duckdb 2275820181 2234160992 1.02
clickbench_q35/duckdb:duckdb 278044063 281553430 0.99
clickbench_q36/duckdb:duckdb 41650112 42586681 0.98
clickbench_q37/duckdb:duckdb 33767042 31552863 1.07
clickbench_q38/duckdb:duckdb 32854987 31151137 1.05
clickbench_q39/duckdb:duckdb 65357349 67527491 0.97
clickbench_q40/duckdb:duckdb 34434134 31834060 1.08
clickbench_q41/duckdb:duckdb 🚨 33417896 29925031 1.12
clickbench_q42/duckdb:duckdb 33888702 32449796 1.04
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed -0.7% -13.1% +14.2% +564.8% ➖ noise
0 duckdb:duckdb +8.9% -13.1% +25.2% +266.6% ➖ noise
0 duckdb:vortex-file-compressed -18.2% -13.1% -6.0% +303.3% ➖ noise
1 datafusion:vortex-file-compressed +12.0% +0.9% +11.0% +28.5% ➖ noise
1 duckdb:duckdb +6.0% +0.9% +5.1% +60.6% ➖ noise
1 duckdb:vortex-file-compressed -14.9% +0.9% -15.7% +18.0% ✅ faster
2 datafusion:vortex-file-compressed -6.9% -0.7% -6.2% +14.2% ➖ noise
2 duckdb:duckdb +1.3% -0.7% +2.1% +22.6% ➖ noise
2 duckdb:vortex-file-compressed -0.4% -0.7% +0.3% +11.2% ➖ noise
3 datafusion:vortex-file-compressed -12.5% -3.2% -9.5% +146.6% ➖ noise
3 duckdb:duckdb +0.2% -3.2% +3.6% +51.3% ➖ noise
3 duckdb:vortex-file-compressed +0.5% -3.2% +3.8% +11.2% ➖ noise
4 datafusion:vortex-file-compressed -1.5% -5.3% +3.9% +12.6% ➖ noise
4 duckdb:duckdb -0.4% -5.3% +5.1% +12.4% ➖ noise
4 duckdb:vortex-file-compressed -10.4% -5.3% -5.4% +20.3% ➖ noise
5 datafusion:vortex-file-compressed -7.5% -4.8% -2.9% +24.1% ➖ noise
5 duckdb:duckdb -3.1% -4.8% +1.7% +11.9% ➖ noise
5 duckdb:vortex-file-compressed -19.3% -4.8% -15.3% +22.7% ➖ noise
6 datafusion:vortex-file-compressed -49.7% -4.5% -47.3% +30.1% ✅ faster
6 duckdb:duckdb -15.6% -4.5% -11.5% +30.5% ➖ noise
6 duckdb:vortex-file-compressed -12.6% -4.5% -8.5% +23.6% ➖ noise
7 datafusion:vortex-file-compressed -28.9% -6.5% -23.9% +13.8% ✅ faster
7 duckdb:duckdb +6.7% -6.5% +14.1% +11.9% 🚨 regression
7 duckdb:vortex-file-compressed -1.3% -6.5% +5.5% +11.2% ➖ noise
8 datafusion:vortex-file-compressed -18.1% -7.5% -11.5% +14.5% ➖ noise
8 duckdb:duckdb -2.8% -7.5% +5.0% +11.2% ➖ noise
8 duckdb:vortex-file-compressed -10.9% -7.5% -3.7% +12.2% ➖ noise
9 datafusion:vortex-file-compressed -22.1% -11.3% -12.1% +12.7% ✅ faster
9 duckdb:duckdb -3.8% -11.3% +8.5% +11.2% ➖ noise
9 duckdb:vortex-file-compressed -8.0% -11.3% +3.8% +11.2% ➖ noise
10 datafusion:vortex-file-compressed +1.8% -5.0% +7.2% +11.2% ➖ noise
10 duckdb:duckdb +0.6% -5.0% +5.9% +11.2% ➖ noise
10 duckdb:vortex-file-compressed -18.5% -5.0% -14.2% +17.1% ➖ noise
11 datafusion:vortex-file-compressed -1.2% -4.1% +3.1% +11.2% ➖ noise
11 duckdb:duckdb -0.6% -4.1% +3.7% +11.2% ➖ noise
11 duckdb:vortex-file-compressed -3.0% -4.1% +1.1% +13.0% ➖ noise
12 datafusion:vortex-file-compressed -6.0% -2.4% -3.7% +11.2% ➖ noise
12 duckdb:duckdb -2.3% -2.4% +0.1% +11.2% ➖ noise
12 duckdb:vortex-file-compressed -19.5% -2.4% -17.5% +16.6% ✅ faster
13 datafusion:vortex-file-compressed -7.6% -8.1% +0.6% +11.2% ➖ noise
13 duckdb:duckdb -4.5% -8.1% +4.0% +11.2% ➖ noise
13 duckdb:vortex-file-compressed -28.7% -8.1% -22.4% +11.2% ✅ faster
14 datafusion:vortex-file-compressed -6.2% -2.5% -3.8% +11.2% ➖ noise
14 duckdb:duckdb -4.1% -2.5% -1.7% +11.2% ➖ noise
14 duckdb:vortex-file-compressed -17.6% -2.5% -15.5% +12.8% ✅ faster
15 datafusion:vortex-file-compressed -1.8% -3.3% +1.5% +12.1% ➖ noise
15 duckdb:duckdb +0.1% -3.3% +3.5% +11.2% ➖ noise
15 duckdb:vortex-file-compressed -5.3% -3.3% -2.1% +11.2% ➖ noise
16 datafusion:vortex-file-compressed -6.0% -10.4% +4.8% +11.2% ➖ noise
16 duckdb:duckdb -8.8% -10.4% +1.7% +11.2% ➖ noise
16 duckdb:vortex-file-compressed -12.7% -10.4% -2.6% +17.8% ➖ noise
17 datafusion:vortex-file-compressed -16.5% -9.9% -7.3% +11.2% ➖ noise
17 duckdb:duckdb -6.3% -9.9% +4.0% +11.2% ➖ noise
17 duckdb:vortex-file-compressed -9.4% -9.9% +0.6% +18.5% ➖ noise
18 datafusion:vortex-file-compressed -6.7% -8.6% +2.2% +11.2% ➖ noise
18 duckdb:duckdb -8.6% -8.6% +0.1% +11.2% ➖ noise
18 duckdb:vortex-file-compressed -3.8% -8.6% +5.3% +11.2% ➖ noise
19 datafusion:vortex-file-compressed +13.5% -9.5% +25.5% +44.6% ➖ noise
19 duckdb:duckdb +10.3% -9.5% +21.9% +11.2% 🚨 regression
19 duckdb:vortex-file-compressed +3.3% -9.5% +14.2% +26.1% ➖ noise
20 datafusion:vortex-file-compressed -8.8% -3.9% -5.1% +188.9% ➖ noise
20 duckdb:duckdb -13.3% -3.9% -9.8% +30.0% ➖ noise
20 duckdb:vortex-file-compressed -1.9% -3.9% +2.1% +11.2% ➖ noise
21 datafusion:vortex-file-compressed -3.9% -5.3% +1.5% +14.6% ➖ noise
21 duckdb:duckdb -6.0% -5.3% -0.7% +11.2% ➖ noise
21 duckdb:vortex-file-compressed -1.0% -5.3% +4.5% +11.2% ➖ noise
22 datafusion:vortex-file-compressed -23.1% -3.6% -20.2% +19.2% ✅ faster
22 duckdb:duckdb -4.9% -3.6% -1.4% +11.2% ➖ noise
22 duckdb:vortex-file-compressed +21.7% -3.6% +26.2% +18.7% 🚨 regression
23 datafusion:vortex-file-compressed -21.9% -8.8% -14.4% +34.5% ➖ noise
23 duckdb:duckdb +1.4% -8.8% +11.1% +11.2% ➖ noise
23 duckdb:vortex-file-compressed -48.4% -8.8% -43.5% +27.2% ✅ faster
24 datafusion:vortex-file-compressed -10.3% -5.6% -4.9% +18.9% ➖ noise
24 duckdb:duckdb +4.9% -5.6% +11.2% +11.2% ➖ noise
24 duckdb:vortex-file-compressed -0.1% -5.6% +5.8% +30.7% ➖ noise
25 datafusion:vortex-file-compressed -0.4% -9.3% +9.8% +13.2% ➖ noise
25 duckdb:duckdb -1.2% -9.3% +8.9% +11.2% ➖ noise
25 duckdb:vortex-file-compressed -3.0% -9.3% +7.0% +11.2% ➖ noise
26 datafusion:vortex-file-compressed -12.0% -7.2% -5.2% +16.0% ➖ noise
26 duckdb:duckdb +5.8% -7.2% +13.9% +14.0% ➖ noise
26 duckdb:vortex-file-compressed -1.7% -7.2% +5.9% +30.5% ➖ noise
27 datafusion:vortex-file-compressed -3.7% -9.3% +6.2% +11.2% ➖ noise
27 duckdb:duckdb -12.2% -9.3% -3.2% +11.2% ➖ noise
27 duckdb:vortex-file-compressed -10.0% -9.3% -0.7% +11.2% ➖ noise
28 datafusion:vortex-file-compressed -3.7% -2.1% -1.6% +11.2% ➖ noise
28 duckdb:duckdb -1.8% -2.1% +0.3% +11.2% ➖ noise
28 duckdb:vortex-file-compressed -1.7% -2.1% +0.4% +11.2% ➖ noise
29 datafusion:vortex-file-compressed -6.5% -3.9% -2.6% +13.4% ➖ noise
29 duckdb:duckdb +4.2% -3.9% +8.5% +11.2% ➖ noise
29 duckdb:vortex-file-compressed -9.3% -3.9% -5.6% +17.4% ➖ noise
30 datafusion:vortex-file-compressed -16.5% -7.5% -9.7% +26.1% ➖ noise
30 duckdb:duckdb -4.8% -7.5% +3.0% +11.2% ➖ noise
30 duckdb:vortex-file-compressed -2.7% -7.5% +5.3% +11.2% ➖ noise
31 datafusion:vortex-file-compressed -9.0% -6.4% -2.8% +29.0% ➖ noise
31 duckdb:duckdb -11.3% -6.4% -5.2% +11.2% ➖ noise
31 duckdb:vortex-file-compressed -4.6% -6.4% +1.9% +11.2% ➖ noise
32 datafusion:vortex-file-compressed -4.8% -10.1% +5.9% +16.2% ➖ noise
32 duckdb:duckdb +0.1% -10.1% +11.2% +11.2% 🚨 regression
32 duckdb:vortex-file-compressed -5.3% -10.1% +5.3% +11.2% ➖ noise
33 datafusion:vortex-file-compressed -11.2% -14.5% +3.8% +17.5% ➖ noise
33 duckdb:duckdb +2.2% -14.5% +19.6% +11.2% 🚨 regression
33 duckdb:vortex-file-compressed -9.2% -14.5% +6.2% +11.2% ➖ noise
34 datafusion:vortex-file-compressed -8.9% -11.6% +3.1% +11.2% ➖ noise
34 duckdb:duckdb +1.9% -11.6% +15.2% +11.2% 🚨 regression
34 duckdb:vortex-file-compressed -13.5% -11.6% -2.1% +11.2% ➖ noise
35 datafusion:vortex-file-compressed -8.9% -3.2% -5.9% +11.2% ➖ noise
35 duckdb:duckdb -1.2% -3.2% +2.0% +11.2% ➖ noise
35 duckdb:vortex-file-compressed -1.4% -3.2% +1.8% +11.2% ➖ noise
36 datafusion:vortex-file-compressed -12.5% -7.6% -5.3% +15.5% ➖ noise
36 duckdb:duckdb -2.2% -7.6% +5.8% +12.2% ➖ noise
36 duckdb:vortex-file-compressed -12.3% -7.6% -5.1% +11.2% ➖ noise
37 datafusion:vortex-file-compressed -16.8% -0.7% -16.2% +15.0% ✅ faster
37 duckdb:duckdb +7.0% -0.7% +7.8% +11.2% ➖ noise
37 duckdb:vortex-file-compressed -11.6% -0.7% -10.9% +11.2% ✅ faster
38 datafusion:vortex-file-compressed -10.1% -10.4% +0.3% +15.2% ➖ noise
38 duckdb:duckdb +5.5% -10.4% +17.7% +13.9% 🚨 regression
38 duckdb:vortex-file-compressed -11.0% -10.4% -0.7% +11.6% ➖ noise
39 datafusion:vortex-file-compressed -13.4% -11.1% -2.5% +15.1% ➖ noise
39 duckdb:duckdb -3.2% -11.1% +8.9% +22.0% ➖ noise
39 duckdb:vortex-file-compressed -4.8% -11.1% +7.1% +13.4% ➖ noise
40 datafusion:vortex-file-compressed -16.5% -10.3% -6.9% +14.1% ➖ noise
40 duckdb:duckdb +8.2% -10.3% +20.6% +14.3% 🚨 regression
40 duckdb:vortex-file-compressed -13.4% -10.3% -3.4% +15.0% ➖ noise
41 datafusion:vortex-file-compressed -22.0% +2.7% -24.1% +11.2% ✅ faster
41 duckdb:duckdb +11.7% +2.7% +8.8% +11.2% ➖ noise
41 duckdb:vortex-file-compressed -16.3% +2.7% -18.5% +12.0% ✅ faster
42 datafusion:vortex-file-compressed -22.8% -2.9% -20.5% +13.6% ✅ faster
42 duckdb:duckdb +4.4% -2.9% +7.5% +11.2% ➖ noise
42 duckdb:vortex-file-compressed -15.6% -2.9% -13.1% +11.2% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 16, 2026

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.03 GB → 7.03 GB (-0.0%)
  • vortex-file-compressed: 13.88 GB → 13.88 GB (0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 16, 2026

Benchmarks: Compression

Vortex (geomean): 1.005x ➖
Parquet (geomean): 1.007x ➖

unknown / unknown (1.009x ➖, 2↑ 4↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
compress time/Arade 1147163498 1171983123 0.98
compress time/Bimbo 6892057105 7129094625 0.97
compress time/CMSprovider 2949364321 2917645074 1.01
compress time/Euro2016 425371994 423116901 1.01
compress time/Food 394434647 384219813 1.03
compress time/HashTags 833879116 803647602 1.04
compress time/TPC-H l_comment canonical 1337154543 1298830241 1.03
compress time/TPC-H l_comment chunked 1310816637 1307579329 1.00
compress time/taxi 713316145 733689528 0.97
compress time/wide table cols=100 chunks=1 rows=1000 🚨 14364389 11755403 1.22
compress time/wide table cols=100 chunks=50 rows=1000 12401613 12371521 1.00
compress time/wide table cols=1000 chunks=1 rows=1000 143239854 138947803 1.03
compress time/wide table cols=1000 chunks=50 rows=1000 137851617 138050169 1.00
compress time/wide table cols=10000 chunks=1 rows=1000 1426017988 1409879821 1.01
compress time/wide table cols=10000 chunks=50 rows=1000 1425607720 1409019024 1.01
decompress time/Arade 31440258 32888427 0.96
decompress time/Bimbo 103070199 103164397 1.00
decompress time/CMSprovider 88710119 87224531 1.02
decompress time/Euro2016 20914610 20767835 1.01
decompress time/Food 10195310 9834267 1.04
decompress time/HashTags 🚨 85377441 75158884 1.14
decompress time/TPC-H l_comment canonical 42000132 40875851 1.03
decompress time/TPC-H l_comment chunked 42871038 40908423 1.05
decompress time/taxi 🚀 20354306 23180104 0.88
decompress time/wide table cols=100 chunks=1 rows=1000 2872458 2960616 0.97
decompress time/wide table cols=100 chunks=50 rows=1000 2763078 2550180 1.08
decompress time/wide table cols=1000 chunks=1 rows=1000 25627505 24570176 1.04
decompress time/wide table cols=1000 chunks=50 rows=1000 25672871 24292923 1.06
decompress time/wide table cols=10000 chunks=1 rows=1000 253723455 244678722 1.04
decompress time/wide table cols=10000 chunks=50 rows=1000 254575336 245293849 1.04
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 3001721501 3088713576 0.97
parquet_rs-zstd compress time/Bimbo 17433926269 17300788917 1.01
parquet_rs-zstd compress time/CMSprovider 7802163158 7699653935 1.01
parquet_rs-zstd compress time/Euro2016 1353720446 1345651952 1.01
parquet_rs-zstd compress time/Food 968554347 934819273 1.04
parquet_rs-zstd compress time/HashTags 2662455342 2453840508 1.09
parquet_rs-zstd compress time/TPC-H l_comment canonical 3163611886 3089768784 1.02
parquet_rs-zstd compress time/TPC-H l_comment chunked 3218561543 3117404621 1.03
parquet_rs-zstd compress time/taxi 1521202232 1519543288 1.00
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6915521 6602906 1.05
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6675304 6654989 1.00
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 88627656 91999006 0.96
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 88578643 92312270 0.96
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 887352004 868671878 1.02
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 866546115 905186257 0.96
parquet_rs-zstd decompress time/Arade 653960415 654149438 1.00
parquet_rs-zstd decompress time/Bimbo 1737595450 1750084454 0.99
parquet_rs-zstd decompress time/CMSprovider 1954219402 1925931619 1.01
parquet_rs-zstd decompress time/Euro2016 388367412 387039019 1.00
parquet_rs-zstd decompress time/Food 224705040 218591411 1.03
parquet_rs-zstd decompress time/HashTags 🚨 714644465 622279375 1.15
parquet_rs-zstd decompress time/TPC-H l_comment canonical 570781643 564364724 1.01
parquet_rs-zstd decompress time/TPC-H l_comment chunked 562676482 566336368 0.99
parquet_rs-zstd decompress time/taxi 246404145 244919859 1.01
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2747984 2704574 1.02
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2666455 2685553 0.99
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 32523766 33440079 0.97
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 32522343 32211738 1.01
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 365936720 376048913 0.97
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 373624344 369774460 1.01
vortex-file-compressed size/Arade 145363828 145363828 1.00
vortex-file-compressed size/Bimbo 468763364 468763364 1.00
vortex-file-compressed size/CMSprovider 417907844 417907844 1.00
vortex-file-compressed size/Euro2016 163599188 163395324 1.00
vortex-file-compressed size/Food 41926968 41926968 1.00
vortex-file-compressed size/HashTags 195647860 195647860 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179087392 179087392 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179087392 179087392 1.00
vortex-file-compressed size/taxi 52363980 52363980 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930880 930880 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930880 930880 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293680 9293680 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293680 9293680 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957680 92957680 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957680 92957680 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.01
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.96
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.00
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.00
vortex:parquet-zstd ratio compress time/Food 0 0 0.99
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.96
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.01
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 0.97
vortex:parquet-zstd ratio compress time/taxi 0 0 0.97
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 🚨 2 1 1.17
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 1.00
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 1.07
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.04
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 0.99
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.06
vortex:parquet-zstd ratio decompress time/Arade 0 0 0.96
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.01
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.00
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.00
vortex:parquet-zstd ratio decompress time/Food 0 0 1.01
vortex:parquet-zstd ratio decompress time/HashTags 0 0 0.99
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.02
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.05
vortex:parquet-zstd ratio decompress time/taxi 🚀 0 0 0.87
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 1 1 0.95
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 1 0 1.09
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.07
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.05
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 1.07
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 1.03
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@0ax1
Copy link
Copy Markdown
Contributor

0ax1 commented Apr 16, 2026

Ideally, we could have a download api in vortex-utils. We also download stuff in vortex-duckdb build.rs etc. Can do in a follow up. As part of that make all downloads atomic etc.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 16, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.5%
Vortex (geomean): 1.134x ➖
Parquet (geomean): 1.163x ➖
Shifts: Parquet (control) +16.3% · Median polish +11.4%

datafusion / vortex-file-compressed (1.205x ➖, 0↑ 6↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 207033231 212426316 0.97
tpch_q02/datafusion:vortex-file-compressed 520298228 565610780 0.92
tpch_q03/datafusion:vortex-file-compressed 429604608 366452694 1.17
tpch_q04/datafusion:vortex-file-compressed 215583318 207926590 1.04
tpch_q05/datafusion:vortex-file-compressed 🚨 641524418 477042988 1.34
tpch_q06/datafusion:vortex-file-compressed 291275112 276626332 1.05
tpch_q07/datafusion:vortex-file-compressed 439543858 370045666 1.19
tpch_q08/datafusion:vortex-file-compressed 669039877 625250889 1.07
tpch_q09/datafusion:vortex-file-compressed 🚨 579768073 429169714 1.35
tpch_q10/datafusion:vortex-file-compressed 605841520 512424595 1.18
tpch_q11/datafusion:vortex-file-compressed 433230098 562087120 0.77
tpch_q12/datafusion:vortex-file-compressed 448421275 347335696 1.29
tpch_q13/datafusion:vortex-file-compressed 🚨 227623442 148764542 1.53
tpch_q14/datafusion:vortex-file-compressed 227813563 179671560 1.27
tpch_q15/datafusion:vortex-file-compressed 453342332 350541864 1.29
tpch_q16/datafusion:vortex-file-compressed 220892134 217666888 1.01
tpch_q17/datafusion:vortex-file-compressed 436721249 360358639 1.21
tpch_q18/datafusion:vortex-file-compressed 🚨 657309025 299380461 2.20
tpch_q19/datafusion:vortex-file-compressed 🚨 585798101 361943991 1.62
tpch_q20/datafusion:vortex-file-compressed 454361071 400653320 1.13
tpch_q21/datafusion:vortex-file-compressed 565902631 470908206 1.20
tpch_q22/datafusion:vortex-file-compressed 🚨 211445649 162540383 1.30
datafusion / vortex-compact (1.109x ➖, 0↑ 4↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 243426226 250188829 0.97
tpch_q02/datafusion:vortex-compact 455826119 450249114 1.01
tpch_q03/datafusion:vortex-compact 411472186 404881274 1.02
tpch_q04/datafusion:vortex-compact 266724650 263581853 1.01
tpch_q05/datafusion:vortex-compact 450164157 359158586 1.25
tpch_q06/datafusion:vortex-compact 347283921 292635966 1.19
tpch_q07/datafusion:vortex-compact 395013588 379451796 1.04
tpch_q08/datafusion:vortex-compact 605640923 548258191 1.10
tpch_q09/datafusion:vortex-compact 🚨 540274619 389565284 1.39
tpch_q10/datafusion:vortex-compact 🚨 633372193 421582515 1.50
tpch_q11/datafusion:vortex-compact 🚨 342162863 257046169 1.33
tpch_q12/datafusion:vortex-compact 545542764 510459187 1.07
tpch_q13/datafusion:vortex-compact 154241963 156386160 0.99
tpch_q14/datafusion:vortex-compact 279945254 251304879 1.11
tpch_q15/datafusion:vortex-compact 539247409 422472371 1.28
tpch_q16/datafusion:vortex-compact 197883082 180187826 1.10
tpch_q17/datafusion:vortex-compact 386061425 358954369 1.08
tpch_q18/datafusion:vortex-compact 🚨 400719437 293698914 1.36
tpch_q19/datafusion:vortex-compact 617298754 482564260 1.28
tpch_q20/datafusion:vortex-compact 487774747 457830163 1.07
tpch_q21/datafusion:vortex-compact 519298229 598411393 0.87
tpch_q22/datafusion:vortex-compact 158939670 221926398 0.72
datafusion / parquet (1.194x ➖, 0↑ 8↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 205565104 219741961 0.94
tpch_q02/datafusion:parquet 🚨 588593766 445042778 1.32
tpch_q03/datafusion:parquet 🚨 518208248 321455970 1.61
tpch_q04/datafusion:parquet 🚨 208635077 154536177 1.35
tpch_q05/datafusion:parquet 🚨 918859359 486595476 1.89
tpch_q06/datafusion:parquet 🚨 202362991 135891697 1.49
tpch_q07/datafusion:parquet 🚨 605537466 462893812 1.31
tpch_q08/datafusion:parquet 730910314 583612404 1.25
tpch_q09/datafusion:parquet 507665914 543296472 0.93
tpch_q10/datafusion:parquet 651449035 654925734 0.99
tpch_q11/datafusion:parquet 332815726 357057670 0.93
tpch_q12/datafusion:parquet 243960151 310886852 0.78
tpch_q13/datafusion:parquet 446988696 530960067 0.84
tpch_q14/datafusion:parquet 186819568 175827458 1.06
tpch_q15/datafusion:parquet 362459208 290090265 1.25
tpch_q16/datafusion:parquet 215990897 180530857 1.20
tpch_q17/datafusion:parquet 🚨 580214666 399610592 1.45
tpch_q18/datafusion:parquet 476022207 451427230 1.05
tpch_q19/datafusion:parquet 361959778 326829377 1.11
tpch_q20/datafusion:parquet 353959433 333068091 1.06
tpch_q21/datafusion:parquet 672201546 610890496 1.10
tpch_q22/datafusion:parquet 🚨 299154989 135304994 2.21
duckdb / vortex-file-compressed (1.124x ➖, 0↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 335364694 299947213 1.12
tpch_q02/duckdb:vortex-file-compressed 1090118758 930269438 1.17
tpch_q03/duckdb:vortex-file-compressed 793846862 637505988 1.25
tpch_q04/duckdb:vortex-file-compressed 415266110 392463403 1.06
tpch_q05/duckdb:vortex-file-compressed 1036649491 958482841 1.08
tpch_q06/duckdb:vortex-file-compressed 478417546 414028794 1.16
tpch_q07/duckdb:vortex-file-compressed 904575126 799758928 1.13
tpch_q08/duckdb:vortex-file-compressed 1087066915 1031468825 1.05
tpch_q09/duckdb:vortex-file-compressed 951009591 898631249 1.06
tpch_q10/duckdb:vortex-file-compressed 757522669 717163509 1.06
tpch_q11/duckdb:vortex-file-compressed 533611982 444872310 1.20
tpch_q12/duckdb:vortex-file-compressed 528192444 522565661 1.01
tpch_q13/duckdb:vortex-file-compressed 548576647 438251978 1.25
tpch_q14/duckdb:vortex-file-compressed 461074127 472735308 0.98
tpch_q15/duckdb:vortex-file-compressed 342260042 320479643 1.07
tpch_q16/duckdb:vortex-file-compressed 442063519 384405927 1.15
tpch_q17/duckdb:vortex-file-compressed 901978742 711575763 1.27
tpch_q18/duckdb:vortex-file-compressed 690586519 566331828 1.22
tpch_q19/duckdb:vortex-file-compressed 507750575 419183890 1.21
tpch_q20/duckdb:vortex-file-compressed 962322852 855650208 1.12
tpch_q21/duckdb:vortex-file-compressed 1254189616 1126706192 1.11
tpch_q22/duckdb:vortex-file-compressed 372908896 345670865 1.08
duckdb / vortex-compact (1.102x ➖, 0↑ 1↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 342436629 292774742 1.17
tpch_q02/duckdb:vortex-compact 986353263 999728492 0.99
tpch_q03/duckdb:vortex-compact 728682107 612616557 1.19
tpch_q04/duckdb:vortex-compact 400751007 341048973 1.18
tpch_q05/duckdb:vortex-compact 1000898266 894426062 1.12
tpch_q06/duckdb:vortex-compact 🚨 579993369 440488980 1.32
tpch_q07/duckdb:vortex-compact 745607468 736763790 1.01
tpch_q08/duckdb:vortex-compact 1036469184 859861838 1.21
tpch_q09/duckdb:vortex-compact 973035669 863019702 1.13
tpch_q10/duckdb:vortex-compact 773339095 686145733 1.13
tpch_q11/duckdb:vortex-compact 511391399 495522988 1.03
tpch_q12/duckdb:vortex-compact 532456103 475795506 1.12
tpch_q13/duckdb:vortex-compact 491100038 452397381 1.09
tpch_q14/duckdb:vortex-compact 505778864 459250955 1.10
tpch_q15/duckdb:vortex-compact 325256155 314115362 1.04
tpch_q16/duckdb:vortex-compact 377375528 358205569 1.05
tpch_q17/duckdb:vortex-compact 700874152 611328016 1.15
tpch_q18/duckdb:vortex-compact 521722390 522761043 1.00
tpch_q19/duckdb:vortex-compact 451048910 410817868 1.10
tpch_q20/duckdb:vortex-compact 920458987 767185641 1.20
tpch_q21/duckdb:vortex-compact 1125644608 1038475435 1.08
tpch_q22/duckdb:vortex-compact 330694093 357194812 0.93
duckdb / parquet (1.133x ➖, 0↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 521917160 411542217 1.27
tpch_q02/duckdb:parquet 1321647309 1260146277 1.05
tpch_q03/duckdb:parquet 1277123662 1058641624 1.21
tpch_q04/duckdb:parquet 694019987 625293876 1.11
tpch_q05/duckdb:parquet 1828035522 1575132032 1.16
tpch_q06/duckdb:parquet 442525876 393081595 1.13
tpch_q07/duckdb:parquet 1470290086 1323978041 1.11
tpch_q08/duckdb:parquet 1986681353 1726841114 1.15
tpch_q09/duckdb:parquet 1558858025 1455787652 1.07
tpch_q10/duckdb:parquet 1487512912 1227327901 1.21
tpch_q11/duckdb:parquet 1009026449 931111316 1.08
tpch_q12/duckdb:parquet 725189742 670139945 1.08
tpch_q13/duckdb:parquet 918813611 927200795 0.99
tpch_q14/duckdb:parquet 835043932 648914147 1.29
tpch_q15/duckdb:parquet 663929692 512443168 1.30
tpch_q16/duckdb:parquet 683352002 658571091 1.04
tpch_q17/duckdb:parquet 898543113 719899713 1.25
tpch_q18/duckdb:parquet 989945830 905551941 1.09
tpch_q19/duckdb:parquet 960197053 790726556 1.21
tpch_q20/duckdb:parquet 1115107239 1129311789 0.99
tpch_q21/duckdb:parquet 1298441096 1202649848 1.08
tpch_q22/duckdb:parquet 637136839 555995860 1.15
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -2.7% +8.9% -10.7% +66.0% ➖ noise
1 datafusion:vortex-file-compressed -2.5% +8.9% -10.5% +70.8% ➖ noise
1 duckdb:vortex-compact +17.0% +8.9% +7.4% +44.5% ➖ noise
1 duckdb:vortex-file-compressed +11.8% +8.9% +2.7% +49.2% ➖ noise
2 datafusion:vortex-compact +1.2% +17.8% -14.0% +44.5% ➖ noise
2 datafusion:vortex-file-compressed -8.0% +17.8% -21.9% +44.5% ➖ noise
2 duckdb:vortex-compact -1.3% +17.8% -16.2% +44.5% ➖ noise
2 duckdb:vortex-file-compressed +17.2% +17.8% -0.5% +44.5% ➖ noise
3 datafusion:vortex-compact +1.6% +39.5% -27.1% +49.5% ➖ noise
3 datafusion:vortex-file-compressed +17.2% +39.5% -15.9% +58.6% ➖ noise
3 duckdb:vortex-compact +18.9% +39.5% -14.7% +44.5% ➖ noise
3 duckdb:vortex-file-compressed +24.5% +39.5% -10.7% +44.5% ➖ noise
4 datafusion:vortex-compact +1.2% +22.4% -17.3% +44.5% ➖ noise
4 datafusion:vortex-file-compressed +3.7% +22.4% -15.3% +56.7% ➖ noise
4 duckdb:vortex-compact +17.5% +22.4% -4.0% +44.5% ➖ noise
4 duckdb:vortex-file-compressed +5.8% +22.4% -13.6% +44.5% ➖ noise
5 datafusion:vortex-compact +25.3% +48.0% -15.3% +44.5% ➖ noise
5 datafusion:vortex-file-compressed +34.5% +48.0% -9.2% +44.5% ➖ noise
5 duckdb:vortex-compact +11.9% +48.0% -24.4% +44.5% ➖ noise
5 duckdb:vortex-file-compressed +8.2% +48.0% -26.9% +44.5% ➖ noise
6 datafusion:vortex-compact +18.7% +29.5% -8.3% +44.5% ➖ noise
6 datafusion:vortex-file-compressed +5.3% +29.5% -18.7% +44.5% ➖ noise
6 duckdb:vortex-compact +31.7% +29.5% +1.7% +44.5% ➖ noise
6 duckdb:vortex-file-compressed +15.6% +29.5% -10.8% +44.5% ➖ noise
7 datafusion:vortex-compact +4.1% +20.5% -13.6% +44.5% ➖ noise
7 datafusion:vortex-file-compressed +18.8% +20.5% -1.5% +44.5% ➖ noise
7 duckdb:vortex-compact +1.2% +20.5% -16.0% +44.5% ➖ noise
7 duckdb:vortex-file-compressed +13.1% +20.5% -6.2% +44.5% ➖ noise
8 datafusion:vortex-compact +10.5% +20.0% -8.0% +44.5% ➖ noise
8 datafusion:vortex-file-compressed +7.0% +20.0% -10.9% +44.5% ➖ noise
8 duckdb:vortex-compact +20.5% +20.0% +0.4% +44.5% ➖ noise
8 duckdb:vortex-file-compressed +5.4% +20.0% -12.2% +44.5% ➖ noise
9 datafusion:vortex-compact +38.7% +0.0% +38.6% +44.5% ➖ noise
9 datafusion:vortex-file-compressed +35.1% +0.0% +35.1% +44.5% ➖ noise
9 duckdb:vortex-compact +12.7% +0.0% +12.7% +44.5% ➖ noise
9 duckdb:vortex-file-compressed +5.8% +0.0% +5.8% +44.5% ➖ noise
10 datafusion:vortex-compact +50.2% +9.8% +36.8% +44.5% ➖ noise
10 datafusion:vortex-file-compressed +18.2% +9.8% +7.7% +44.5% ➖ noise
10 duckdb:vortex-compact +12.7% +9.8% +2.7% +44.5% ➖ noise
10 duckdb:vortex-file-compressed +5.6% +9.8% -3.8% +44.5% ➖ noise
11 datafusion:vortex-compact +33.1% +0.5% +32.4% +44.5% ➖ noise
11 datafusion:vortex-file-compressed -22.9% +0.5% -23.3% +44.5% ➖ noise
11 duckdb:vortex-compact +3.2% +0.5% +2.7% +44.5% ➖ noise
11 duckdb:vortex-file-compressed +19.9% +0.5% +19.3% +44.5% ➖ noise
12 datafusion:vortex-compact +6.9% -7.8% +16.0% +44.5% ➖ noise
12 datafusion:vortex-file-compressed +29.1% -7.8% +40.1% +48.1% ➖ noise
12 duckdb:vortex-compact +11.9% -7.8% +21.4% +44.5% ➖ noise
12 duckdb:vortex-file-compressed +1.1% -7.8% +9.7% +44.5% ➖ noise
13 datafusion:vortex-compact -1.4% -8.7% +8.0% +57.7% ➖ noise
13 datafusion:vortex-file-compressed +53.0% -8.7% +67.5% +44.5% 🚨 regression
13 duckdb:vortex-compact +8.6% -8.7% +18.9% +44.5% ➖ noise
13 duckdb:vortex-file-compressed +25.2% -8.7% +37.0% +44.5% ➖ noise
14 datafusion:vortex-compact +11.4% +16.9% -4.7% +44.5% ➖ noise
14 datafusion:vortex-file-compressed +26.8% +16.9% +8.4% +45.5% ➖ noise
14 duckdb:vortex-compact +10.1% +16.9% -5.8% +44.5% ➖ noise
14 duckdb:vortex-file-compressed -2.5% +16.9% -16.6% +44.5% ➖ noise
15 datafusion:vortex-compact +27.6% +27.2% +0.3% +44.5% ➖ noise
15 datafusion:vortex-file-compressed +29.3% +27.2% +1.6% +44.5% ➖ noise
15 duckdb:vortex-compact +3.5% +27.2% -18.6% +44.5% ➖ noise
15 duckdb:vortex-file-compressed +6.8% +27.2% -16.1% +44.5% ➖ noise
16 datafusion:vortex-compact +9.8% +11.4% -1.4% +44.5% ➖ noise
16 datafusion:vortex-file-compressed +1.5% +11.4% -8.9% +44.5% ➖ noise
16 duckdb:vortex-compact +5.4% +11.4% -5.4% +44.5% ➖ noise
16 duckdb:vortex-file-compressed +15.0% +11.4% +3.2% +44.5% ➖ noise
17 datafusion:vortex-compact +7.6% +34.6% -20.1% +44.5% ➖ noise
17 datafusion:vortex-file-compressed +21.2% +34.6% -10.0% +44.5% ➖ noise
17 duckdb:vortex-compact +14.6% +34.6% -14.8% +44.5% ➖ noise
17 duckdb:vortex-file-compressed +26.8% +34.6% -5.8% +44.5% ➖ noise
18 datafusion:vortex-compact +36.4% +7.4% +27.1% +44.5% ➖ noise
18 datafusion:vortex-file-compressed +119.6% +7.4% +104.5% +44.5% 🚨 regression
18 duckdb:vortex-compact -0.2% +7.4% -7.0% +44.5% ➖ noise
18 duckdb:vortex-file-compressed +21.9% +7.4% +13.6% +44.5% ➖ noise
19 datafusion:vortex-compact +27.9% +16.0% +10.3% +44.5% ➖ noise
19 datafusion:vortex-file-compressed +61.8% +16.0% +39.6% +44.5% ➖ noise
19 duckdb:vortex-compact +9.8% +16.0% -5.3% +44.5% ➖ noise
19 duckdb:vortex-file-compressed +21.1% +16.0% +4.5% +44.5% ➖ noise
20 datafusion:vortex-compact +6.5% +2.4% +4.0% +44.5% ➖ noise
20 datafusion:vortex-file-compressed +13.4% +2.4% +10.7% +44.5% ➖ noise
20 duckdb:vortex-compact +20.0% +2.4% +17.1% +44.5% ➖ noise
20 duckdb:vortex-file-compressed +12.5% +2.4% +9.8% +44.5% ➖ noise
21 datafusion:vortex-compact -13.2% +9.0% -20.4% +44.5% ➖ noise
21 datafusion:vortex-file-compressed +20.2% +9.0% +10.3% +44.5% ➖ noise
21 duckdb:vortex-compact +8.4% +9.0% -0.6% +44.5% ➖ noise
21 duckdb:vortex-file-compressed +11.3% +9.0% +2.1% +44.5% ➖ noise
22 datafusion:vortex-compact -28.4% +59.2% -55.0% +44.5% ✅ faster
22 datafusion:vortex-file-compressed +30.1% +59.2% -18.3% +44.5% ➖ noise
22 duckdb:vortex-compact -7.4% +59.2% -41.8% +44.5% ✅ faster
22 duckdb:vortex-file-compressed +7.9% +59.2% -32.2% +44.5% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 16, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.3%
Vortex (geomean): 1.039x ➖
Parquet (geomean): 1.042x ➖
Shifts: Parquet (control) +4.2% · Median polish +5.6%

datafusion / vortex-file-compressed (1.032x ➖, 0↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 726451972 742978261 0.98
tpch_q02/datafusion:vortex-file-compressed 818860216 776282720 1.05
tpch_q03/datafusion:vortex-file-compressed 933012392 884884723 1.05
tpch_q04/datafusion:vortex-file-compressed 629459400 589532483 1.07
tpch_q05/datafusion:vortex-file-compressed 1065188670 1120911655 0.95
tpch_q06/datafusion:vortex-file-compressed 647182217 622853643 1.04
tpch_q07/datafusion:vortex-file-compressed 1210143479 1170405210 1.03
tpch_q08/datafusion:vortex-file-compressed 1166671453 1147218320 1.02
tpch_q09/datafusion:vortex-file-compressed 1368380413 1447687121 0.95
tpch_q10/datafusion:vortex-file-compressed 973088963 1193949211 0.82
tpch_q11/datafusion:vortex-file-compressed 498069731 515388485 0.97
tpch_q12/datafusion:vortex-file-compressed 963851845 891453633 1.08
tpch_q13/datafusion:vortex-file-compressed 517124784 459939671 1.12
tpch_q14/datafusion:vortex-file-compressed 711171167 559963466 1.27
tpch_q15/datafusion:vortex-file-compressed 1300149866 1107863524 1.17
tpch_q16/datafusion:vortex-file-compressed 358215001 334776060 1.07
tpch_q17/datafusion:vortex-file-compressed 1233435997 1538451438 0.80
tpch_q18/datafusion:vortex-file-compressed 1461186502 1478190327 0.99
tpch_q19/datafusion:vortex-file-compressed 865109804 719982534 1.20
tpch_q20/datafusion:vortex-file-compressed 1035110803 953637454 1.09
tpch_q21/datafusion:vortex-file-compressed 1684140918 1685063595 1.00
tpch_q22/datafusion:vortex-file-compressed 372820707 337059532 1.11
datafusion / vortex-compact (1.091x ➖, 0↑ 2↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 714434272 764709162 0.93
tpch_q02/datafusion:vortex-compact 672776251 671019360 1.00
tpch_q03/datafusion:vortex-compact 1001618023 824845280 1.21
tpch_q04/datafusion:vortex-compact 594685750 537727014 1.11
tpch_q05/datafusion:vortex-compact 1003431077 1083415276 0.93
tpch_q06/datafusion:vortex-compact 619227815 654715489 0.95
tpch_q07/datafusion:vortex-compact 1186964607 1110550610 1.07
tpch_q08/datafusion:vortex-compact 1360641996 1120716623 1.21
tpch_q09/datafusion:vortex-compact 1284572223 1327092374 0.97
tpch_q10/datafusion:vortex-compact 933983577 881130575 1.06
tpch_q11/datafusion:vortex-compact 454779630 385328158 1.18
tpch_q12/datafusion:vortex-compact 959252015 787927435 1.22
tpch_q13/datafusion:vortex-compact 483901032 442379459 1.09
tpch_q14/datafusion:vortex-compact 642597734 621558641 1.03
tpch_q15/datafusion:vortex-compact 1115497132 1121845860 0.99
tpch_q16/datafusion:vortex-compact 328469372 341338842 0.96
tpch_q17/datafusion:vortex-compact 1194352748 1328127084 0.90
tpch_q18/datafusion:vortex-compact 1112686067 1306499783 0.85
tpch_q19/datafusion:vortex-compact 🚨 1416672237 695042029 2.04
tpch_q20/datafusion:vortex-compact 🚨 1358960210 877623606 1.55
tpch_q21/datafusion:vortex-compact 1556189025 1610071875 0.97
tpch_q22/datafusion:vortex-compact 496947921 390107211 1.27
datafusion / parquet (0.980x ➖, 0↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 872211880 872429117 1.00
tpch_q02/datafusion:parquet 786849171 903640191 0.87
tpch_q03/datafusion:parquet 923447651 966508505 0.96
tpch_q04/datafusion:parquet 468561243 535033064 0.88
tpch_q05/datafusion:parquet 1136852232 1250472996 0.91
tpch_q06/datafusion:parquet 501157542 509715383 0.98
tpch_q07/datafusion:parquet 1340088983 1631480191 0.82
tpch_q08/datafusion:parquet 1722398237 1903021735 0.91
tpch_q09/datafusion:parquet 1722987343 1989645714 0.87
tpch_q10/datafusion:parquet 2057000708 2049144401 1.00
tpch_q11/datafusion:parquet 746440125 601192654 1.24
tpch_q12/datafusion:parquet 811731604 715262701 1.13
tpch_q13/datafusion:parquet 775039930 787938539 0.98
tpch_q14/datafusion:parquet 853461077 775027030 1.10
tpch_q15/datafusion:parquet 1234549460 1269124594 0.97
tpch_q16/datafusion:parquet 405277935 433994520 0.93
tpch_q17/datafusion:parquet 1382757918 1528276437 0.90
tpch_q18/datafusion:parquet 1672288796 1506361141 1.11
tpch_q19/datafusion:parquet 1029557121 948020588 1.09
tpch_q20/datafusion:parquet 1320500797 1298743608 1.02
tpch_q21/datafusion:parquet 1761530491 1961728054 0.90
tpch_q22/datafusion:parquet 851388675 764035545 1.11
duckdb / vortex-file-compressed (1.008x ➖, 0↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 633351380 686528063 0.92
tpch_q02/duckdb:vortex-file-compressed 1206159190 1134122269 1.06
tpch_q03/duckdb:vortex-file-compressed 946007099 943555912 1.00
tpch_q04/duckdb:vortex-file-compressed 686117396 664036441 1.03
tpch_q05/duckdb:vortex-file-compressed 1142816740 1143326140 1.00
tpch_q06/duckdb:vortex-file-compressed 800043604 942676604 0.85
tpch_q07/duckdb:vortex-file-compressed 1161870049 1141210404 1.02
tpch_q08/duckdb:vortex-file-compressed 1550741773 1427527732 1.09
tpch_q09/duckdb:vortex-file-compressed 1519686727 1448066586 1.05
tpch_q10/duckdb:vortex-file-compressed 1206557607 1131242025 1.07
tpch_q11/duckdb:vortex-file-compressed 670403859 638614868 1.05
tpch_q12/duckdb:vortex-file-compressed 785435899 751116467 1.05
tpch_q13/duckdb:vortex-file-compressed 907016968 926323616 0.98
tpch_q14/duckdb:vortex-file-compressed 919971370 889885782 1.03
tpch_q15/duckdb:vortex-file-compressed 563705915 578811728 0.97
tpch_q16/duckdb:vortex-file-compressed 474781210 512649991 0.93
tpch_q17/duckdb:vortex-file-compressed 973209329 1008175673 0.97
tpch_q18/duckdb:vortex-file-compressed 974576844 933734652 1.04
tpch_q19/duckdb:vortex-file-compressed 789364809 790832426 1.00
tpch_q20/duckdb:vortex-file-compressed 1227132486 1164833788 1.05
tpch_q21/duckdb:vortex-file-compressed 2020323774 1991889154 1.01
tpch_q22/duckdb:vortex-file-compressed 641444077 624392450 1.03
duckdb / vortex-compact (1.029x ➖, 0↑ 0↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 621218879 603831475 1.03
tpch_q02/duckdb:vortex-compact 1025749147 1045279127 0.98
tpch_q03/duckdb:vortex-compact 833708256 804907976 1.04
tpch_q04/duckdb:vortex-compact 539185685 518833313 1.04
tpch_q05/duckdb:vortex-compact 995967044 1103835417 0.90
tpch_q06/duckdb:vortex-compact 719407843 763928765 0.94
tpch_q07/duckdb:vortex-compact 1110888287 1054728544 1.05
tpch_q08/duckdb:vortex-compact 1368862564 1354069984 1.01
tpch_q09/duckdb:vortex-compact 1306695868 1362202176 0.96
tpch_q10/duckdb:vortex-compact 1120486940 1010835810 1.11
tpch_q11/duckdb:vortex-compact 737059903 642350449 1.15
tpch_q12/duckdb:vortex-compact 786941774 643620121 1.22
tpch_q13/duckdb:vortex-compact 872270739 850864472 1.03
tpch_q14/duckdb:vortex-compact 855152975 795739304 1.07
tpch_q15/duckdb:vortex-compact 553270536 545193395 1.01
tpch_q16/duckdb:vortex-compact 446671454 424911229 1.05
tpch_q17/duckdb:vortex-compact 984841972 893071909 1.10
tpch_q18/duckdb:vortex-compact 767717244 696960403 1.10
tpch_q19/duckdb:vortex-compact 755271410 748589992 1.01
tpch_q20/duckdb:vortex-compact 1211128137 1313562786 0.92
tpch_q21/duckdb:vortex-compact 1724115489 1659171658 1.04
tpch_q22/duckdb:vortex-compact 594505535 642272598 0.93
duckdb / parquet (1.108x ➖, 0↑ 2↓)
name PR f4e605c (ns) base e8374a4 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 1006262926 992864354 1.01
tpch_q02/duckdb:parquet 1600678227 1557088290 1.03
tpch_q03/duckdb:parquet 1860404271 1764264943 1.05
tpch_q04/duckdb:parquet 🚨 1389034486 1007491770 1.38
tpch_q05/duckdb:parquet 2649439347 2136142875 1.24
tpch_q06/duckdb:parquet 🚨 995892566 723350629 1.38
tpch_q07/duckdb:parquet 2001062013 1779872070 1.12
tpch_q08/duckdb:parquet 3217748559 2483660414 1.30
tpch_q09/duckdb:parquet 2864570571 2479888956 1.16
tpch_q10/duckdb:parquet 3361100615 3038058584 1.11
tpch_q11/duckdb:parquet 1129104357 1069753823 1.06
tpch_q12/duckdb:parquet 1371384086 1260797785 1.09
tpch_q13/duckdb:parquet 1321957709 1196759824 1.10
tpch_q14/duckdb:parquet 1309614485 1258130886 1.04
tpch_q15/duckdb:parquet 887393378 903719491 0.98
tpch_q16/duckdb:parquet 929607364 868301186 1.07
tpch_q17/duckdb:parquet 1361073706 1190915188 1.14
tpch_q18/duckdb:parquet 1454013051 1340006252 1.09
tpch_q19/duckdb:parquet 1495313648 1495429734 1.00
tpch_q20/duckdb:parquet 2008182106 1807427816 1.11
tpch_q21/duckdb:parquet 1823151732 1776104916 1.03
tpch_q22/duckdb:parquet 1090582282 1082791005 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -6.6% +0.7% -7.2% +45.1% ➖ noise
1 datafusion:vortex-file-compressed -2.2% +0.7% -2.9% +42.8% ➖ noise
1 duckdb:vortex-compact +2.9% +0.7% +2.2% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -7.7% +0.7% -8.4% +37.2% ➖ noise
2 datafusion:vortex-compact +0.3% -5.4% +6.0% +36.1% ➖ noise
2 datafusion:vortex-file-compressed +5.5% -5.4% +11.5% +38.8% ➖ noise
2 duckdb:vortex-compact -1.9% -5.4% +3.7% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +6.4% -5.4% +12.4% +30.0% ➖ noise
3 datafusion:vortex-compact +21.4% +0.4% +21.0% +40.7% ➖ noise
3 datafusion:vortex-file-compressed +5.4% +0.4% +5.0% +39.0% ➖ noise
3 duckdb:vortex-compact +3.6% +0.4% +3.2% +34.2% ➖ noise
3 duckdb:vortex-file-compressed +0.3% +0.4% -0.1% +30.8% ➖ noise
4 datafusion:vortex-compact +10.6% +9.9% +0.6% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +6.8% +9.9% -2.8% +30.0% ➖ noise
4 duckdb:vortex-compact +3.9% +9.9% -5.4% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +3.3% +9.9% -6.0% +30.0% ➖ noise
5 datafusion:vortex-compact -7.4% +6.2% -12.8% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -5.0% +6.2% -10.5% +30.0% ➖ noise
5 duckdb:vortex-compact -9.8% +6.2% -15.0% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -0.0% +6.2% -5.9% +30.0% ➖ noise
6 datafusion:vortex-compact -5.4% +16.3% -18.7% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +3.9% +16.3% -10.7% +30.0% ➖ noise
6 duckdb:vortex-compact -5.8% +16.3% -19.1% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -15.1% +16.3% -27.1% +30.0% ✅ faster
7 datafusion:vortex-compact +6.9% -3.9% +11.2% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +3.4% -3.9% +7.6% +30.0% ➖ noise
7 duckdb:vortex-compact +5.3% -3.9% +9.6% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +1.8% -3.9% +5.9% +30.0% ➖ noise
8 datafusion:vortex-compact +21.4% +8.3% +12.1% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +1.7% +8.3% -6.1% +30.0% ➖ noise
8 duckdb:vortex-compact +1.1% +8.3% -6.6% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +8.6% +8.3% +0.3% +30.0% ➖ noise
9 datafusion:vortex-compact -3.2% +0.0% -3.2% +30.0% ➖ noise
9 datafusion:vortex-file-compressed -5.5% +0.0% -5.5% +30.0% ➖ noise
9 duckdb:vortex-compact -4.1% +0.0% -4.1% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +4.9% +0.0% +4.9% +30.0% ➖ noise
10 datafusion:vortex-compact +6.0% +5.4% +0.6% +30.0% ➖ noise
10 datafusion:vortex-file-compressed -18.5% +5.4% -22.7% +30.0% ➖ noise
10 duckdb:vortex-compact +10.8% +5.4% +5.2% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +6.7% +5.4% +1.2% +30.0% ➖ noise
11 datafusion:vortex-compact +18.0% +14.5% +3.1% +30.0% ➖ noise
11 datafusion:vortex-file-compressed -3.4% +14.5% -15.6% +30.0% ➖ noise
11 duckdb:vortex-compact +14.7% +14.5% +0.2% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +5.0% +14.5% -8.3% +30.0% ➖ noise
12 datafusion:vortex-compact +21.7% +11.1% +9.6% +30.0% ➖ noise
12 datafusion:vortex-file-compressed +8.1% +11.1% -2.7% +30.0% ➖ noise
12 duckdb:vortex-compact +22.3% +11.1% +10.0% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +4.6% +11.1% -5.9% +30.0% ➖ noise
13 datafusion:vortex-compact +9.4% +4.2% +4.9% +30.0% ➖ noise
13 datafusion:vortex-file-compressed +12.4% +4.2% +7.9% +30.0% ➖ noise
13 duckdb:vortex-compact +2.5% +4.2% -1.7% +37.0% ➖ noise
13 duckdb:vortex-file-compressed -2.1% +4.2% -6.1% +41.8% ➖ noise
14 datafusion:vortex-compact +3.4% +7.1% -3.4% +30.0% ➖ noise
14 datafusion:vortex-file-compressed +27.0% +7.1% +18.6% +30.0% ➖ noise
14 duckdb:vortex-compact +7.5% +7.1% +0.4% +30.0% ➖ noise
14 duckdb:vortex-file-compressed +3.4% +7.1% -3.4% +30.0% ➖ noise
15 datafusion:vortex-compact -0.6% -2.3% +1.7% +30.0% ➖ noise
15 datafusion:vortex-file-compressed +17.4% -2.3% +20.1% +30.0% ➖ noise
15 duckdb:vortex-compact +1.5% -2.3% +3.8% +30.0% ➖ noise
15 duckdb:vortex-file-compressed -2.6% -2.3% -0.4% +30.0% ➖ noise
16 datafusion:vortex-compact -3.8% -0.0% -3.8% +30.0% ➖ noise
16 datafusion:vortex-file-compressed +7.0% -0.0% +7.0% +32.4% ➖ noise
16 duckdb:vortex-compact +5.1% -0.0% +5.1% +30.0% ➖ noise
16 duckdb:vortex-file-compressed -7.4% -0.0% -7.4% +30.0% ➖ noise
17 datafusion:vortex-compact -10.1% +1.7% -11.6% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -19.8% +1.7% -21.2% +30.0% ➖ noise
17 duckdb:vortex-compact +10.3% +1.7% +8.4% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -3.5% +1.7% -5.1% +30.0% ➖ noise
18 datafusion:vortex-compact -14.8% +9.8% -22.4% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -1.2% +9.8% -9.9% +30.0% ➖ noise
18 duckdb:vortex-compact +10.2% +9.8% +0.4% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +4.4% +9.8% -4.9% +30.0% ➖ noise
19 datafusion:vortex-compact +103.8% +4.2% +95.6% +31.3% 🚨 regression
19 datafusion:vortex-file-compressed +20.2% +4.2% +15.3% +30.0% ➖ noise
19 duckdb:vortex-compact +0.9% +4.2% -3.2% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -0.2% +4.2% -4.2% +30.0% ➖ noise
20 datafusion:vortex-compact +54.8% +6.3% +45.7% +31.5% 🚨 regression
20 datafusion:vortex-file-compressed +8.5% +6.3% +2.1% +30.0% ➖ noise
20 duckdb:vortex-compact -7.8% +6.3% -13.3% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +5.3% +6.3% -0.9% +30.0% ➖ noise
21 datafusion:vortex-compact -3.3% -4.0% +0.7% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -0.1% -4.0% +4.1% +30.0% ➖ noise
21 duckdb:vortex-compact +3.9% -4.0% +8.2% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +1.4% -4.0% +5.6% +30.0% ➖ noise
22 datafusion:vortex-compact +27.4% +5.9% +20.2% +34.0% ➖ noise
22 datafusion:vortex-file-compressed +10.6% +5.9% +4.4% +30.0% ➖ noise
22 duckdb:vortex-compact -7.4% +5.9% -12.6% +30.0% ➖ noise
22 duckdb:vortex-file-compressed +2.7% +5.9% -3.0% +30.0% ➖ noise

@robert3005 robert3005 merged commit 5e5475a into develop Apr 16, 2026
93 of 98 checks passed
@robert3005 robert3005 deleted the rk/downloads branch April 16, 2026 11:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@0ax1 0ax1 0ax1 approved these changes

Assignees

No one assigned

Labels

changelog/chore A trivial change

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@robert3005 @0ax1